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ABSTRACT 

In 1990*91, £0 countries (Brazil, Cana d a, China, 
England, France, Hungary, Ireland, Israel, Italy, Jordan, Korea, 
Mozambique, Portugal, Scotland, Slovenia, Soviet Union, Spain, 
Switzerland, Taiwan, and the United States) surveyed the mathematics 
and science performance of 13-year-old students (and 14 countries 
also assessed 9-year-olds in the same subjects* as part of the second 
International Assessment of Educational Progress (IAEP) Project. 
While recognizing the fundamental differences from country to 
country, the participants assembled tests that focus on the common 
elements of their curriculums, and in-order to form the contexts for 
interpreting the student achievement data, they added sets of 
questions about students' home background and classroom experiences 
and the characteristics of the schools they attended. Results are 
reported in six chapters that discuss the following: (1) the 
mathematics performance of 13-year-olds; (2} results organized around 
topics featured in the curriculum; (3) results reporting students' 
and administrators' perceptions of teaching practices and their 
relationship to student performance; (4) information about the 
backgrounds of students and how they spend their time outside of 
school; (5) information about physical, demographic, and 
socioeconomic characteristics and the educational systems of the 
participating countries; and (6) the mathematics performance of 
9-year-olds. Other sections present highlights of the findings 
discussed in detail in the main chapters, information about the 
participating countries, a procedural appendix discussing the 
research methods used by the countries, and a data appendix providing 
tables of results reported in the main chapters. (MDH) 
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The Study in Brief 



Participant*: Twenty countries assessed the mathematics and science achievement 
of 13-year-old students mid 14 assessed 9-year-old students in these same subjects. 
In some cases, participants assessed virtually all age-eligible children in their 
countries and in other cases they confined samples to certain geographic 
regions, languag e groups, or grade levels. In some countries, significant propor- 
tions of age-eligible children were not represented because they did not attend 
school. Also* in some countries* low rates of school or student participation 
mean results may be biased. 



Participant!* 



Brazil 


Cities of Sao Ffeolo and FbrtaJesa. restricted grades. in~school population 


Canada 


Four provinces at age 9 and ni ic out of 10 provinces at age 13 


China 


20 out of 29 provinces and independent cine*, restricted grades. 




in-sckool population 


England 


All student*, tow participation at ages 9 and 13 


France 


All students 


Hungary 


All students 


Ireland 


Ail students 


Israel 


Hebrew-Speaking schools 


Italy 


Province of Emilia-Romagna. low participation at age 9 


Jordan 


All students 


Korea 


AH students 


Mozambique 


Cities of Maputo and Beira. in-school population, low participation 


Portugal 


Restricted grades, in-school population at age 13 


Scotland 


Ail students* tow participation at age 9 


Slovenia 


All students 


Soviet Union 


14 out of 15 republics. Russian-speaking schools 


Spain 


All regions except Cataluna. Spanish** peaking schools 


Switzerland 


15 out of 26 cantons 


Taiwan 


All students 


United State* 


All students 



Sample*: Typically, a random sample of 3.300 students from about 110 
different schools was selected from each population at each age level; half 
were assessed in mathematics and half in science. A total of about 175.000 
9- and 13-year-olds (those born in calendar years 1981 and 1977, respectively) 
were tested in 13 different languages in March 1991. 

We»*niritl: The achievement tests lasted one hour. At age 9. they included 
62 questions in mathematics and 60 questions in science. At age 13. the tests 
included 76 questions in mathematics and 72 questions in science. In addition, 
students at each age spent about 10 minutes responding to questions about 
their backgrounds and home and school experiences. School administrators 
completed a school questionnaire. 
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Introduction 



Ah, la belle chose, 

que de savoir quelque chose. 

Ah, what a lovely thing it is* 

to know something. MoIi» n- 



Each of the countries that participated in the second International 
Assessment of Educational Progress ( IAEP) did mi for its own reasons. 
Some wanted to compare their results with those of neighbors or 
competitors. Others wanted to ieam about the educational jmliries ami 
practices of countries whose students seem to regularly achieve surress in 
mathematics anil science. Still others wantetl to establish a baseline of data 
within their own countries against which they can measure progress in the 
future. 

\II participants, however, shared a common interest in identifying 
what is fwssihle for today"* M- and 13-year-old children to know and to tie 
aide to do in mathematics and science. While critics warn of the dangers of 
promoting an educational olympiad* the benefits of periodically gathering 
comparative data must he considered. Knowledge of what is passible 
produces new enthusiasm, raises sights, establishes new challenges, and 
ultimately can help improve (personal and societal {performance. 

Some might say that a study that compares the United States with 
Slovenia or England with Sao Paulo. Brazil is inappropriate or irrelevant. 
Education is. in fact. iml>eddcd in each society and culture* and 
l>erformance should not he studied or described without considering the 
important differences from country to country. The life of a 13-year-old in 
a rural Chinese community is very different from that of his or her peer 
growing tip in a miJdlc-elass Paris apartment. And yet. these two young 
citizens may well meet in the global marketplace 20 years from now. Ami if 
thev do. chances are thev will relv on the mathematics and science thev 
learned in this decade to succeed in the complex business and technological 
environment of 2012* 

While recognising the fundamental differences from country to 
country, the participants in the second IAEP project assembled tests that 
focus on the common elements of their currieulums. and in order to form 
the contexts for interpreting the student achievement data, they added sets 



of questions about student*' home background and classroom experiences 
and the characteristics of the schools they attend. 

This report, then, is organised according to those contexts that 
surround and affect student performance: the curriculum, classroom 
practices, home environments, and the characteristics of countries and 
their education systems. While survey research project like IAEP cannot 
establish cause-and-effect relationships, these studies can provide clues 
that may help explain high and low performance. 

Occasionally, the findings are counterintuitive. For example, in 
some countries, less well-trained teachers with large classes and poor- 
quality instructional materials sometimes produce students who achieve 
truly exceptional results. In other countries, students of better paid, better 
trained teachers, who work in schools that are more generously supported 
perform less well on the IAEP tests. The results presented in this report 
will highlight some of these paradoxes. 

One possible reaction to this report would be for a country to 
examine the results and attempt to find out how to become Number 1 in the 
world. A more thoughtful course of action would be for each country to use 
this information to set reasonable goals that are in harmony with its own 
values and culture. 

The achievement results reported here can help identify what is 
passible for 9- and 13-year-olds to achieve and the descriptive information 
can suggest practices and rurriculums that others are using successfully. It 
seems reasonable to expert that each country may find elements worth 
emulating in the practices of its neighbors and comjtetitnrs. 

AtOtffTMMOJIC? In 1990-91. a total of 20 countries surveyed the mathematics 
and science performance of 13-year-old students and 14 also assessed 9- 
year-olds in the same subjects. An optional short prolie of the geography 
achievement of 13-year-oids and an experimental performance-based 
assessment of 13-year-olds* ability to use equipment and materials to solve 
mathematics and science problems were also conducted by som? 
participants and their results will be presented in forthcoming reports. 

Some countries drew samples from virtually all children in the 
• appropriate age group; others confined their assessments to specific 
geographic areas, language groups, or grade levels. The definition of 
populations often followed the structure of school systems,, political 
divisions, and cultural distinctions. For example, the sample in Israel 
focused on students in Hebrew-speaking schools, which share a common 
curriculum, language, and tradition. The assessment in Slovenia reflected 
the needs and aspirations of this recently separated republic of Yugoslavia. 
The restriction to certain grades in the Portuguese assessment was 



necessitated by a very dispersed student population resulting from a 
unique education system that allows students to repeat any grade up to 
three times. All countries limited their assessment to students who were in 
school, whieh for some participants meant excluding significant numbers of 
age-eligible children. In a few cases, a suable proportion of the selected 
schools or students did noi participate in the assessment* and therefore 
results are subject to possible nonresponse bias.' 

A list of the participants is provided below with a description of 
limitations of the populations assessed. Unless noted* 90 percent or more of 
the age-eligible children in a population are in school. For countries where 
more than 10 percent of the age-eligible children are out *>f school a 
notation of inschooi population appears after the count* y j name. In 
Brazil* two separate samples were drawn* one each from the cities of Sao 
Paulo and Fortalexa. In Canada, nine out of the 10 provinces drew 
separate samples of 13-year-olds and five of these drew separate samples of 
English-»|>caking and French-speaking schools, for a total of 14 separate 
sample*. Four Canadian provinces* six separate samples, participated in 
the assessment of 9-year-olds.- These distinct Canadian samples coincide 
with the separate provincial education systems in Canada and reflect their 
concern for the two language groups they serve. 



PARTICIPANTS 
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1 Pfrrmtanrs of agi*H*ltf»l>lt» r hiHn»a excluded from *amplr* ami prrr*»nta|er* nf *ampied *rhool* and 
«ttnient& that participated an* provided in the Procedural Appendix, pp. 131-132 and 134-135. 

-Taken fofp-iner. the Canadian wmpb reprenent 94 perrmt of the IS-year-oMa ami 74 percent of 
the* °~?ear-okli in Canada* An appropriately weighted *ub*arapte of troponin** was drawn from 
the*: sample* for the calculation of the *iati*tir* for Canada. 



Typically, a representative sample of 3,300 students from 1 10 
different schools was selected from each population at each age level and 
half were assessed in mathematics and half in science. 3 A total of about 
175,000 9- ami 13-year-olds (those born in calendar years 1981 and 1977 , 
respectively) were tested in 13 different l anguag es in March 1991 * 

Steps to ensure the uniformity ami quality of the surveys were taken 
at all stages of the project. While procedures could not always be followed 
in exactly the same way in each of the separate assessment centers, overall 
compliance was very high, as shown in the quality control procedures 
provided in the figure on the next page.* Translations and adaptations of 
assessment materials were carefully checked for accuracy. All questions 
were pilot-tested in participating countries before they were used in the 
final assessment. Comparable sampling designs were used by all 
participants and the quality of their implementation was carefully checked 
and documented. Participants were provided with training and computer 
software to facilitate their tasks and to ensure uniformity and quality. Test 
administrators were trained to administer the tests to students using the 
name set of instructions and time limits. The standardization of 
administration procedures was carefully checked within each country and 
across countries by an international monitoring team. While the reports of 
the quality control observers were for the most part completed check lists, 
some impressionistic observations of international monitoring team 
members are interspersed throughout this report to give a more personal 
view of the test administrations in several countries. The accuracy of the 
database was validated through independent checks of a random selection 
of completed student test booklets and school questionnaires; the accuracy 
of the data analysis was validated by comparing the results obtained using 
different statistical programs and computer equipment. 



*THe number* of *rbool» and Mudrnts in earn *«mplr are provided in the Procedural Appendix, 
pp. 1.14-135. 

* Because their school yearn begin In March instead of September. Brest], Korea, and Mozambique 
as*c*»ed »n months earlier m September 1990. and to compensate for the earner assessment in 
Braail and Korea, they sampled students who were six months older (born between July 1. 1976 
through June 30, 1977). Moiambiqoe assessed students born in 1977 in mathematics only. 

5 Additional dor omen tation of data collection is provided in the Procedural Appendbu pp. 139-141 
and in Adam Cho. et ai, IAEP Technical Report. Princeton. NJ. Educational Testing Service. 
1992. 
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sfutients from eoch participating country (weep! Sovenia, which joined the project toe) to detemrae whkh questions 

MMFIfS MOimowm VfWf KO Samples for each population were dniwn using ogrednipon pwt^ ^ 
were mdependent fy checked info UoitdStote 
weights were appropriately adadrttd. 

mcnwii mahoais mo hahmm nmrn ftocedwd manuals were developed for mnfaafag the 
fypjed,Aw^sqw|te 

dntotssa. R egional froifwg sessions were held c! whkh fhe individucb from eoch assessment center who octuoHy performed 
the tasks were provided detailed instruct!** end hands-on experiences. 

comrontsofiwui^tiwoio Speck'Wdewtepedcompu^softwt^ 
faofitote sampling ond data entry end to ensure uniformity end quality. 

smtOAiotzio Tin AMfumiTUTtow Test booklets were administered to cfdenft using fhe same instructions 
and fhe same time limits in eoch participating awtry. lb ©sure pwe&nes were understood, test odmimsJrotOfs, usually 
school personnel were trwwdm Moot of 79 assessment centers. 

ON-SITI OISIWATIO* Of ASIISSMMTS Unannounced observations of 10 to 20 percent of the test 
administrations we conducted by 22 out of 29 assessment center 

iNNMHOf M? ouautt cONTtoi in d countries except Bmzfl end Itozombtque, an independent, framed 
observer interviewed the country project manager about oil aspects of the project and visited one or more test 
odimrostrfltton sites. In roost coses, the observer wos fluent si the language of the assessment, 

data litis AM oata AMALYSI5 ¥AU0AT10 The scoring of open-ended mathematics questions was checked in 19 
percent of Ihe booklets by 27 out of 29 assessment centers and in oil coses, accuracy of scoring wos 98 percent or higher 
Eoch country validated its own doto fifes, using software provided by the project, to ascertain the* quality and occinocy. 
Data files were aiso independentty vcfelated by compemg tf» respoases of o random set of 10 student booklets and ]Q 
school questionnaires of each type lo the data entered into the databases. If data f3es contained 1 percent errors or 
grecter, participants were osked to rekey all the responses. This happened in one cose. Data analysis procedures were 
checked by cckukrttng stafetks using different programs cm! computer equipment end comparing the results 

ASUSfAUMT QUI STtOHS CfffCKIO f Ot COMtCOUA Of CULTURAL !UAS Assessment fesutts were checked to 
verify that responses to iraftvidual questions could be summarized without fmsrepfc^trng curriculcr or cuttural 
differences within particular countries. Cluster cnalys« ond analyses of differentia! item functioning (Off) resulted in the 
removal of one mathematics question ot each age level, two science questions ot age 9 f and eight ot age )3 before final 
analyses were conducted. 




WORD ft 10 BT COMrftllSOMS A major challenge of international studies is to 
provide fair comparisons of student achievement. Some of the problems 
faced by these studies are similar to those of any survey research project. 
For example, samples must he adequately drawn, test administration 
procedures must he scrupulously adhered to, care must he taken to 
produce accurate data files. These concerns are not trivial. However, 
international stuuies must also address a number of unique issues that stem 
from the differences in language, culture, and education systems of the 
participating countries/ 

Three a rear, of concern warrant special attention: the 
representativeness of the target population, the appropriateness of the 
measures, and educational and cultural differences. As indicated earlier, 
some participants confined assessments to particular geographic areas, 
language groups, or grade levels and in some cases, significant numbers of 
age-eligible children were not attending school and in other cases, participation 
rates of schools or students were low. These limitations are described in 
more detail in the figure on the following page. There is simply no way to 
measure the bias intn>durcd when certain groups of children are excluded 
from a sample or when response rates are low: their participation could 
have raised (performance nrores. lowered them, or not affected tric.n at all. 

To address concerns of representativeness, all populations have been 
named on all of the figures and in the text in ways that highlight the major 
limitations of their assessment* For example. Italy is listed in the figures 
and in the text as Emilia- Romagna the actual province that was 
assessed, and China is listed in the figures as "China — in-school 
population, restricted grades. 20 provinces and cities," 1 and in the text as 
"China (in-srhool imputation}/* its major limitation. 

Countries also differ with respeet to the appropriateness of the 
rurrirular areas the 1AEP assessment sought to measure. All countries 
participated in the development of the mathematics and science frame- 
works that guided the design of the instruments: currirular experts in each 
country reviewed all potential questions for their appropriateness for their 
own students. 7 While acceptable to all. the resulting tests do not match all 
countries* curricula equally well. Differences in curriculum emphasis are 
documented alongside the performance of each country in various 
eurricular areas in Chapter Two. 



* A thoughtful treatment of the ismic* involved in interna thmal studic* is djttrtnwed in Norman M. 
Bradtnirn and Fhtrothy M. Gilford. Eds.. A Frumewark and Principknfor International 
Comparative Studies in Education* Washington. D.C.. National Academy Press. 1990. 

"A full dbetuMMon of the development of frameworks and selection of questions is provided in 
Center for the Attornment of Educational Progress, The 1991 IAEP Assessment. Objectives for 
Mathematics. Science, and Geography, Prince' m. NJ. Educational Testing Service. 1991. 



Descriptions of Limited Populations** 
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Furthermore, the testing format — multiple-choice ami short-answer 
questions — is not equally familiar to studen** from all countries. To 
address this issue, participants were given the option of administer \ 
practice test to sampled students prior to the assessment. Finally, s<; ~r 
countries differ in the age at which students start school and policies for 
promotion, students at ages 9 and 13 are further along in their schooling in 
some countries than in others. 8 While all results presented in this rc|M*rt 
represent performance of all students in each age group, participants were 
also provided with results broken down by the two most common grade 
levels for students in each age group. 

International results must ultimately be interpreted in light of the 
educational and cultural context of each country. The countries 
participating in IAEP are large and small, rich and poor, and have varied 
ethnic, religious, language, and cultural traditions. Likewise, educational 
goals, expectations, and even the meaning of achievement vary from nation 
to nation. As a reminder of these differences ansong countries, results are 
presented along with relevant contextual information that is designed to 
help the reader interpret their significance. 



*See the Procedural Appendix, pp. 137 158 for the distribution of » indent » by grade level. 



Highlights 



• Factors thai impart academic performance interact in wtnplex way* ami 
operate differently in various cultural ami educational systems. Then* is no 
single formula for success. 

• The I AEP results demonstrate what in possible for 9- and 13-year-olds to 
achieve in mathematics. This information can l>c instructive to |>oiicy makers 
as they attempt to set goals ami standards for their own young citizens. 

• In almost all 13-year-old imputations, at least 10 | percent of the students 
;>erformcd very well (20 points or more aitove the I AEP average) ami at 
least 10 |>crccnt performed |>oorly (20 points or more below the I AEP 
average). In China (in-school population), however, even students in the 
10th percentile j>erformcd close to the I AEP average. 

• in about one-third of the populations- 13-year-old l>oys fterformrd 
significantly better than girls that age. Nevertheless, in almost all 
populations, three quarters or more of the students felt "mathematics is for 
boys and girls about equally." 

• Most countries include whole-number ulcerations in their instructional 
programs for age 13. Students in mnny countries that emphasise geometry 
or algebra performed well in those topics as well as in mathematics overall. 
Taiwan, a high-performing population is an exception: their schools do not 
emphasize geometry at this age level. Although Spain {except Cataluna)* 
Portugal (restricted grades . Sao Paulo (restricted grades), and Fortaleza 
(restricted grades) all emphasize algebra at age 13. students in those places 
were lower performers. 

• Teaching practices, types of instructional materials, teacher background, 
and classroom organization vary from country to country for children at 
age 13; moreover* these factors do not distinguish between high-performing 
and low-performing populations. 
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• Within individual populations* greater frequency of teacher presentation 
and independent work are associated with higher performance for the 
majority of IAEP participants, suggesting either the importance of 
intensity of instruction in general or of these practices in particular. 

• Thirteen-year-old students in most participating countries do not spend a 
great deal of time doing mathematics homework. The most common 
response is one hour or less each week in all populations except Korea and 
Israel, where the norm is two to three hours weekly and China, where the 
most common response is four hours or more weekly. 

• Thirteen-year-olds are much more likely to spend their spare time 
watching television than studying. The norm is two to four hours of 
television viewing eoch day in all but two IAEP populations. In China 
(in-school population), 65 percent of the students reported watching little 
or no television on a daily basis. Slightly more than one-half of the students 
in France reported watching one hour or less of television each day. 

• While socioeconomic factors seem to be associated with mathematics 
jM*rformancc at age 13 in many IAEP populations, so are students 1 out-of- 
school activities. Amount of leisure reading and time spent on all 
homework is positively related to mathematics achievement, while amount 
of time spent watching television is negatively related in about one-half 
participating countries* 

• The range of average performance across the 14 populations 
participating in the IAEP assessment at age 9 was 20 points, and in almost 
all populations, at least 10 percent of the students performed very well (20 
points or more above the IAEP average) and at least 10 percent performed 
poorly (20 points or more below the IAEP average). 

• The difference in performance between 9- and 13-year-olds in each of the 
14 populations ranged from a 22- to 32~point increase. 



Mathematics Performance 
of 13-Year-01ds 



Quel che si Unpara in gioventu, 
Mon si dimentica mai piu. 
What is learned in youth. 
Will neve' be forgotten. 

Italian l'rmerli 



The results presented in this chapter reflect some of what 13-year- 
olds know and can do in mathematics in the 20 countries. The 
percentages displayed in the tables and graphs reflect the 
percentages of questions that groups of students from the 
various populations answered correctly. In addition to group 
averages, the figures display how the best students (90th to 99th 
percentiles) and the least successful ( 1st to 10th percentiles) from each 
population performed on the assessment. Next to each printed statistic, in 
parentheses, is an estimate of sampling error.*' It is especially important to 
consider the imprecision in the estimates when comparing two populations 
with similar results. 

Results are presented separately for two groups: comprehensive 
populations and pop* lations with exclusions or low participation. 
Comprehensive populations are those that included in the assessment 

'The f-fttimair of sampling error providrd » ■ jarkknifed standard error, It ran U> said with ¥5 
permit certainty that for each population of intercut, the value for the whole population is within 
± 2 standard errors of the estimate for the sample. 
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virtually all age-eligible children within a defined group, even if the group 
was limited to a specific geographic area or a certain l a ng uage group* 
Populations with exclusions or low participation are those that excluded 
from the assessment a significant proportion (more than 10 percent) of 13- 
year-olds from within the defined group, typically because not all grade 
levels were assessed or because some children were not in school, or those 
where participation of sampled schools and students was low (less than 70 
percent). 

In the figures that follow* two kinds of data are displayed: the 
comparative achievement results as well as indicators of cultural and 
educational differences. These cultural and educational characteristics are 
drawn from international databases, country questionnaires completed by 
project directors, school questionnaires completed by school 
administrators, and student questionnaires completed by the assessed 
students. The source of each piece of descriptive data is indicated by a 
footnote* 

The descriptive data permit easier and more thoughtful 
interpretation of the significance of achievement results. Key 
characteristics of participants, their education systems, classrooms, 
homes, and students are presented, along with a graphic representation of 
achievement in the attached fold-out CHART. The average perrents 
correct and distribution of scores are repeated in FIGURE 1.1. After the 
introduction of overall achievement results in this chapter, they are 
discussed in more depth, along with contextual information, in the 
chapters that follow. 
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ovitAU «ATll«ATtcS ItlBlTl The results are presented in Figure 1.1, The 
green bare indicate the average percent correct for each population and 
take into account the imprecision of these estimates due to sampling. When 
the bars overlap, as they do in many cases, it indicates that the 
performances of those populations do not differ significantly. 

The average score across the comprehensive populations and 
populations with exclusions or low participation, represented by a vertical 
dashed line, is 58 percent. 18 Students in Scotland, Ireland. Slovenia, and 
England (low participation ) performed at about the IAEP average. 

The highest perforating students were those assessed in China 
(in-school population), with an average of 80 percent correct. The other 
populations performing above the average, from highest to lowest, were 
Korea, Taiwan, Switzerland ( 15 cantons), Soviet Union (Russian-speaking 
schools), Hungary, France, Emitia-Romagna, Israel (Hebrew), and 
Canada. As the overlapping bars on the figure indicate, performance levels 
were essentially the same for many of these populations. 

Students from Spain (except Catalufia) and the United States scored 
just beiow the IAEP average and those from Portugal (restricted grades) 
somewhat lower. Lower still was the performance of students from Jordan 
and Sao Paulo (restricted grades) and the two lowest performing groups 
were the students assessed in Fortalexa (restricted grades) and those from 
Maputo- Beira (in-school population). 

The {performance of the individual Canadian populations which 
contribute to the overall Canada score ranged from 53 to 69 percent 
correct. However, as the overlapping bars in the figures indicate, the 
scores often are not significantly different from one population to another, 
Nova Scotia. Newfoundland, Ontario (English). Manitoba (English), and 
New Brunswick (English) all )>erfnrmed about at the IAEP average. 

Those scoring above the average, from highest to lowest, were 
Quebec (French). Saskatchewan (French)* British Columbia. Quebec 
(English), Alberta, Manitoba (French), Saskatchewan (English), and New 
Brunswick (French). Ontario (French) is the only Canadian population 
that scored below the IAEP average. 



It'The IAEP average m the unweighted average of the wrore* of the romprehenwve population* and 
population* with pxrluaion* or low participation. An unweighted average ha* been ehotten to 
<ie*cribe the mid pom t berauae it i« not influenced by the differential weights of very targe and 
very umaU population*. 



Mathematics. Age 13 

Distribution of Percent Correct Score* by Population* 
FI90H i.i Part 1 
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Mathematics, Age 13 

Distribution of Percent Correct Scores by Population* 
Mtsti i.i Part 2 
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Achievement reflects the pen* * corrert on 75 questions. Responses 
to one question included in the assessment were removed from the results 
after a series of data analysis steps explored the consistency of 
j«*rformance across countries, topics, and individual items. These 
procedures were designed to identify questions that were not functioning in 
the same way across all populations." Such items are not considered to be 
bad items; they simply did not seem to measure the same content or skill in 
ail of the population*, probably because of rurrieular differences or 
because of cultural or linguistic idiosyncracies, 



1 * Sff> thr Procedural Appendix, p. 142-143. and the iAEP Terhmc&i Report fi*r a firfatied ilt**-*!*- 




*km «*f rluntpr ami differential item fanrtkming anahwpN. 
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siea lift 10* iCItlfflf Averages provide a useful picture of group 

performance among participants* However, the technological leaders of 
the 2 1st century will probably come from the highest-performing students 
in schools today. Figure LI also shows the range of correct responses for 
the top-performing students from each population (the 90th through the 
99th percentiles). These data reflect the achievement levels of the best 
students. Of equal concern is what can be done to improve the results of 
each population's poorest performers. Also displayed are the ranges of 
results for the lowest performing students in each population assessed 
(the 1st through the 10th percentiles). The average perrents correct for 
students at the 5th and 95th percentiles are indicated by a bullet inside the 
shaded bar. 12 

Percentiles represent locations in the distribution of scores- If the 
average percent correct for the 5th percentile is 30 percent* it means that 
the 5 percent of the population who are the lowest scorers answered 30 
percent or fewer of the questions correctly. If the average percent correct 
for the 95th percentile is 90. the 5 percent of the population who are the 
highest scorers answered 90 percent or more of the questions correctly. 

The pattern of results for high and low achievers tend to mirror the 
averages, but they also demonstrate that in almost all populations there are 
some very good students (scoring at least 20 points above the 1AEP 
average) and some poor students (scoring at least 20 points below the IAEP 
average). Some extremes can be noted. Students in the 10th percentile 
from China (in-school population) performed close to the IAEP average 
and those in the 10th percentile from Switzerland (15 cantons) answered 
over one-half of the questions correctly. Only the very best students 
assessed in Maputt*~Beira (in-school population) attained scores at the 
IAEP average. 



12 Performance «*f sUidefttR at the very bottom of ibe distribution llbr lowest I permit > ami at the 
vrry top ithe ht$he*i I permit > are not represented on the figure beeauae very few students fall 
into these categories and their performance cannot be estimated with precision. 
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MATMf «Af ICS MIFOIBAICI If 8IIBII FIGURE L2 reports the average 

mathematics* performance for males and females at age 13 and the degree to 
which students agreed that mathematics is equally appropriate for both 
groups. In nearly every population, almost all students assessed agreed 
with the statement "mathematics is for hoys and girls about equally," 
Performance of females and males did not differ significantly in most (all 
hut eight) of the comprehensive populations and populations with 
exclusions or low participation. The performance of boys was significantly 
higher than that of girls in Switzerland (15 cantons), France, Emilia- 
Romagna. Canada, Ireland, Spain (except Catalufia), China (in-sehool 
population), and Fortalesa ( restricted grades). These finding in some cases 
confirm and in other cases contradict those of other national and 
international studies. u Inconsistencies in results may be due to differences 
in the content coverage of assessments, since in many countries, girls 
typically perform better in some topics and boys in others* or to differences 
in sample designs. 

For most Canadian populations* boys outscored girls about as much 
as they did for Canada as a whole. However, because sampling errors are 
greater for the individual Canadian populations, these differences are not 
statistically significant. Newfoundland is a notable exception. Here the 
j performance of girls was significantly higher than that of boys. 

Interestingly, the three countries that were more likely to view 
mathematics as gender-linked — Korea, Taiwan, and Jordan — did not 
exhibit significant differences in performance by gender. In Korea. 27 
j percent of the students felt that mathematics is more for boys and 17 
percent that it is more for girls; in Taiwan. 15 {percent felt that mathematics 
is more for boys and 8 percent felt that it is more for girls; and in Jordan. 
15 percent of the students felt that mathematics is more for boys and 9 
jM*n*ent that it is more for girls. 



13 For f*xaro pit*. rt**itit* for England n»pHran*d iKose of the fir*! IAEP stud? bat nmtradkt findings 
from national monitoring Httrdk** and the Second International Mathemattro Study. 



Mathematics, Age 13 

Percentages of Strdents Reporting Math Is Equally for Boys 
anil Girls ami Average Percents Correet* 
Fifion 1.2 Part 1 
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Mathematics, Age 13 

Percentages of Students Reporting Math is Kiftialiy for Boy* 
pi o 01 1 1.1 and Girls and Average Prreents Corrert* 

Part 2 
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A fits? lOdi AT illBlff While the mathematics achievement ranged from 28 to 
80 average percents correct, there is evidence of the potential of each 
population, as demonstrated in the performance of ih? top 10 permit of the 
students in each country. The data from the bottom 10 percent remind us 
that even the most successful countries have students who need further help 
and encouragement. 

Most students in most participating countries believe that mathematics 
is equally important for boys and girls. Still, in more than one-third of the 
comprehensive populations and populations with exclusions or low 
participation, behavior does not match attitude and 13-year-old boys 
perform significantly better than girls at that age. 

While it is tempting to look only at which country is Number i, the 
IAEP results can only be useful if they inform educators* policy makers, 
and the public about characteristics of high and low performers- To that 
end, the achievement results are examined in relation to school, home, and 
societal factors in the chapters that follow. 




TAIWAN March 15. 1991 

The motto of the modem, suburban, junior high school was "Perserverance. 
Determination. Justice, and Honesty: Be Free from Laziness. Awkwardness. Partiality, 
and FaUehotni. m The serious challenges of this admonition did not seem to inhibit the 
enthusiasm of about 20 pom-pom girts clad in cheerful yellow and white costumes 
rehearsing their routines in the warm, humid sunshine. 

"This junior high has only been coeducational for a couple of years." I was informed 
as soon as 1 entered the door. And indeed 1 notu ed almost as many boys as girls in their 
crisp blue uniforms hurrying up and down the four flights of stairs to their classes in the 
107 classnxtms. As we drank tea and ate shaobing and youtiao in the contemporary 
lounge outside the main office, the dean told me that the change had mused the faculty to 
re-evaluate the content of the home economics courses. 

The sampled students fded quietly into the large, modern, sloped auditorium. They 
quickly seated themselves at the desks facing a stage, whose walls were coveretl with 
painting! of distinguish*! figures and several scrolls of calligraphy written by schmd 
officials urging students to apply themselves. One of them warnetl 
ominously. "When you po to use your knowledge, you will regret 
that you haven't ieurnal more." 

The pleusont. enthusiastic. Li -year-old faces remnineil 
that way throughout the exercise. The students natural 
and unselfcottscious courtesy expressetl itself in bows 
and "she she's" 1 thank-you'sh as they left the room. 

ETS Ouality Control Observer 
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cii pti it two O homem e o autor de si mesmo. 

Man is his own author. 

Dflfim Santos 
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While politicians and the public may be most interested in the 
overall performance of children, these findings have only limited 
utility for educators charged with developing student 
competence. Knowledge and skills are taught in segments that 
are usually organized around topics featured in the curriculum 
and in textbooks* Results showing that students perform poorly can only 
sound a general alarm. Teachers and administrators must know which are 
the specific areas of students' strength and weakness before they can target 
their limited time and resources. 

While initial analyses of the data confirm that questions across all of 
the topic areas can be summarized without masking important differences 
between population*, results by topic presented in this chapter do show 
some variation. 14 This is understandable because countries differ in their 



*■* A country -by-topic interaction analysis using Hartigan and Wong a K-Mcans Huster analyst* 
technique radicated that the difference* in performance from topk to topic do not confound the 
main effects of overall performance. This means that the relative perform* nee of countries would 
remain essentially the same if a group of items from a partirniar topic or topics were removed 
from the overall summary measure. More details of this analysis are provided in the Procedural 
Appendix, p. 142. ami in the IAEP Technical Report, 
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approaches to teaching mathematics to 13-year-olds. While the 1AEP 
assessment was based on a consensus description of the topics and cognitive 
processes that all participants agreed were both taught in their schools and 
appropriate for this age group* the assessment is not aligned with any 
specific country's curriculum. The materials included in the assessment are 
neither given equal emphasis nor taught on the same time schedule in all 
participating countries. Furthermore, the importance ascribed to what is 
not covered by the IAEP assessment varies from country to country. 

The results for students of age 13 are presented in this chapter for 
five content areas typically taught in mathematics: Numbers and 
Operations; Measurement; Geometry; Data Analysis, Statistics and 
Probability; and Algebra and Functions. The distribution of questions by 
topic is shown in FIGURE 2.1. Three quarters of the questions used a 
multiple-choice format and the remaining questions required students to 
write their answers on fines provided. 

Mathematics, Age 13: 

Numlwrs of Questions by Topir 

NkNflbaV! 
end 



*BMiflS ARB OPEIAIIOMS About 35 percent of the assessment of 
13-year-olds focused on Numbers and Operations* a total of 27 questions. 
Samples of a relatively easy and of a relatively hard question from this 
category and their average difficulty levels are shown in FIGURE 2.2. ,s 
Short descriptions of all of the questions in this category and their average 
difficulty levels are provided in the Data Appendix along with the same 
information for items in the other four content areas. The questions for 
13-year-olds assessed students 4 basic understanding of numerical 
operations as well as of concepts of number lines, place values, negative 
numbers, multiples, odd and even, fractions, decimals, percents, and 
ratios. Questions require students to adds subtract, multiply, and divide 
using whole numbers (including negative numbers), fractions, and 
decimals. Many tasks are imbedded in problems that require one or more 
operations. 





1 5 The difficulty level for sample questions for this and subsequent topics is an unweighted average of 
the item percent* correct across the comprehensive population* and populations with exclusions or 
low participation, 
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risen 1.2 Mathematics, Age 13: 

Sample Test Questions for IN umbers unci Operations 



IAEP ftem Average rt% 

Subtract: 



® 17.8 
B 18.2 
C 18.8 
D 22.2 



21.2 
-3.4 



Uff ten forage «% 

A group of students has a total of 29 pencils. 
Six students have 1 pencil eaeh, 5 students 
have 3 pencils each, and the rest have 2 pencils 
each. How many students have only 2 pencils? 

*: 

C 8 
D 9 



Comprehensive populations and populations with exclusions or low 
participation an* listed in order of performance arn»>>* all mathematics 
questions in FIGURE 2.3. The bars display both the 1AKP average across 
all populations in the two groups anil the average percent* correct for each 
fMipulation for Numbers and Operations. The numeric average* and 
standard errors for this topic ami the other content and process categories 
are provided in the Data Ap|»cndix. 
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Id general, the relative performance of the two population groups on 
Numbers ami Operations mirrors their overall achievement in 
mathematics. This is shown by the fact that the bars representing the topic 
averages generally follow the same pattern as the green bars representing 
overall averages in Figure LI in Chapter One. 

The patterns of performance were examined to see if the performance of 
a population on a particular topic was different from its overall perform- 
ance and some exceptions were identified. Since the average difficulty level 
of the questions in the various topics and across all topics differs, perform- 
ance was examined in relative terms. The difference between a population's 
topic average and the IAEP topic average was compared with the 
difference between the population's overall average and the IAEP overall 
average. If the difference between those deviations was greater than what 
might be expected due to sampling error, the population's performance on 
that topic was identified as an exception. In some cases, performance on a 
topic was identified as higher compared to achievement overall and in some 
cases it was identified as relatively lower than performance in general. 1 * 

For example, students in Maputo-Beira (in -school population) were 
identified as performing at relatively higher levels in Numbers and 
Operations than they did overall. On this topic, these students scored 27 
points below the IAEP Numbers and Operations average of 61 but across 
all mathematics questions, they scored 30 points below the IAEP overall 
mathematics average of 58. Students assessed in the Soviet Union (Russian- 
speaking schools) performed less well in Numbers and Operations relative 
to their performance overall because they scored 8 points above the IAEP 
topic average but scored 12 points above the IAEP overall average. In both 
cases, these differences, in absolute terms, are greater than would be 
expected due to sampling error, Scotland is the only other population that 
was identified as performing differently in Numbers and Operations as 
compared with its overall performance. Like the Soviet Union (Russian- 
speaking schools), its performance was lower in this topic relative to its 
overall mathematics achievement. 



* 6 For these analyses of achievement by topes, populations are cited an deviating from their normal 
pattern if the difference between their deviation from the mean for the topic and their deviation 
from the overall mean b twice the standard error of difference between these deviations, or 
greater. Further details of these analyses are provided in the Procedural Appendix, p. 143* and 
the iAEP Techmetst Re ort. 



Mathematics, Age 13 

Percentages of Schools that Emphasize Five Numbers and 
Operations Subtopics and Average Percent* Correct for 
pisbri l.s Numbers and Operations* 
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Figure 2.3 alao shows the percentage of schools from each population 
that reported they emphasised various numbers and operations subtopics 
« lot in the modal grade for 13-year-olds in their country (typically grade 7 
or 8). ,T Patterns of instruction vary from country to country. Most 
countries still provide instruction on whole number operations at this level 
hut emphasis on the more complex operations differs, with some countries 
focusing on common and decimal fractions, others on ratios and 
proportion*, and still others on percent. Several high-perforating 
imputations — Korea. Taiwan, and China — do not emphasize the various 
numbers and operations subtopics as much at this age level as the other 
population* do. 

MIASOIIHINT The 1 3 Measurement questions focused on understanding basic 
measurement concepts and applying them in typical classroom problems 
and real-world situations. Questions required students to work with units 
of length and to solve problems involving length, width, perimeter, area, 
volume, ami surface area, primarily of squares, rectangles, cubes, and 
rectangular solids. The ability to read scale drawings was also assessed. 
Typical measurement questions are presented in FIGURE 2.4. 

Questions such as those in the first example were adapted from non- 
metric to metric units in countries as appropriate, but the actual quantities 
involved in the measurements were not changed. Some questions expressed 
in metric units, like those in the second example, were administered in both 
metric ami n on- metric countries, but these tasks did not require students 
to understand nor to lie able to use metric units to solve the problem. 




1 "Swral ffurftJiomi in ibf IAEP u#f* 13 »rbno) fjuf^nonnaire foruwfi on thr trarh«»r* and fdura- 
tmnal program for p-ade in whir!) mo»t J3- v>ar-<»M* an* rnriiHril. or the modal aradr. Earh 
roiintry taiWrd ft» ijurntioanairr to indiratp thr appropriate title for that gradr — r.g., junior 
high 2 in Korea ami Taiwan. 7th rla»* Us Orman SwiiaerlamK Rth %■•» ar in Fn-nrh ami Italian 
SwitEfHand. 8tb Hamt in the Sovirt L 'ninn. 
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Mathematics. Age 13: 

Sample Te*t Quotums for Measurement 



The area of a rectangle is 24 aqua re inches 
ami the measures of its length and width are 
whole number*. Which of the following are 
NOT possible dtmen«oo» for the rectangle? 

A length - 6 inches, width • 4 inches 
B length » 8 inches, width « 3 inches 
©length- 12 inches, width- 12 inches 
D length ■ 24 inches, width •» t inch 



What is the total surface area of the cube shown above? 

A 240 square centimeters 

B 400 square centimeters 

@ 600 square centimeters 

D 1,000 square centimeters 



A* FIGl RE 2.7> shows* Measurement is a topie in which students 
from Kmilia-Knmagnu did tetter romp a red with their overall mathematics 
arhievrment: its sehinds reported that they gave this topie heavy emphasis 
at this ape level. Thirteen year-olds in Maputo-Beira 4tn-*ehoo! population) 
also had relatively higher scores on thin topic than they did on the 
mathematics test as a whole. Israel {Hebrew}. Spain (except Cataluna). the 
United States, and Portugal {restricted grade*) performed lens well in thin 
topic eompared to their total mathematics |>erforfnanee. As w^s seen Air 
NumlMTH anil Operations* the high-performing imputations of Korea* 
Taiwan, and China fin-school population) did not emphasize measurement 
at this age level. 
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Mathematics, Age 13 

Percentages of Sehools that Emphasize Measurement and 
Average Pereents Correct for Measurement* 
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xMathematics, Age 13; 

Sample Test Questions for Geometry 




6I0IURY The IAEP Geometry tusks, which represented 13 ju-rrent of the 

assessment, assessed pro|»ertu*s of circles* ree tunnies, triangles, ctities. 
angles, am! lines of symmetry. The II different question* required students 
to visualize geometric figures and to demonstrate knowledge in typical 
elasspHim ami practical situations. Two examples are shown in EIGl RE 2.6. 

The assessment results for Geometry an* presented in FIGURE 2,7. 
Era nee. Emiiia-Romagna. and Scotland all |*erformcd hetter in this topic, 
rnmpaml with their performance overall. Geometry was a major part of 
the curriculum at this age level in all Emilia-Komugna schools. Ireland, the 
Unite I States. Sao Paulo (restricted grades), and Eortaleza (restricted 
grades) performed relatively less well in Geometry than they did overall. 
Many top-performing populations emphasized geometry at this age level: 
Korea, the Soviet Union ( Russian-s|>caking schools)* Hungary. Emilia- 
Homagna. and China (in-school population). An exception is Taiwan, a 
high |>erformer overall, where geometry was not emphasized at age 13. 
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Mathematics, Age 13 

Percentages of Schools that Emphasize Geometry 
and Average Percents Correct for Geometry* 
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DATA All It T SIS, STATISTICS, AIO FlOIAfUITY Thf» nine questions in this 
category assessed a sample of data analysis (7). statistics (1), and 
probability (1) tasks. Students were required to read and interpret bar 
charts, line graphs, rirrle graphs, and data tables, to compute an 
arithmetic mean, and to demonstrate an understanding of basic probability 
concept*. Since this topic area focused on mathematical applications, the 
tanks were cast in a variety of practical settings. Sample questions from this 
topic are shown in FIGURE 2.8. 

A large number of exceptions to the overall pattern of performance 
are seen in FIGURE 2,9, Six populations performed better in this topic 
compared to their overall achievement: France. Canada. Scotland, the 
United States. England (low participation), and Portugal (restricted 
grades). The Soviet Union ( Russian-speaking schools), Slovenia. Jordan, 
and Maputo-Beira (in-school population) anhieved at relatively lower leveL 
in this topic, and China (in-school population), which did not emphasize 
thiH topic at age 13. scored below its usual superior level. 

In almost all participating countries, schools indicated that they 
emphasised charts and graphs more than they did probability and statistics 
topics: in the assessment, most of the questions fell into thi» area of charts 
and graphs. These questions proved to l>e relatively easy compared witb 
questions in other topics. 
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Mathematics. Age 13: 

Sample Text (Juwtioiift for Data Analysis. IVohahiliiy. 
and Statistics 
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In a certain city, the 9:00 a.m. temperatures 
recorded for one week were 

9°C t 7°C. 6°C, 0°C, 2°C, 8°C % and I0*C. 

What was the average (arithmetic mean) 
temperature for 9:00 a.m. for that week? 

B 7°C 
C 8°C 

D 9.5°C 



Which of the following is a true statement 
about the information shown in the graph 
above? 

A Grade 8 has the least number of students, 
(8) Grade 9 has twice as many boys as girts. 
C Grade 10 baa more girls than boys* 
D Grade* 8 ami 10 have the same number 
of students. 



4? 



fi»8ti a.t 



Mathematics - Age 13 

Percentages of Schools that Emphasize Tables and (iraphs. 
Probability* and Statistics and Average Percent* Correct 
for Data Analysis, Probability, and Statistics* 
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AlCEPtAAriD FUNCTIONS Twenty percent of the assessment. 13 questions. 

meaMuml Algebra and Functions. Examples of two of the questions arc 
*hown in FIGURE 2 JO. Students were asked to demonstrate an 
understanding of algebraic and functional concept* and use theac concepts 
to solve problems involving formulae, verbal descriptions, diagrams, and 
tables. Students were required to express relationships in equations, to 
substitute numbers for variables, and to solve formulas for one variable. 

The results for this topic are presented in FIGURE 2. U. The Soviet 
Union i Russian-speaking schools), Hungary. Israel ( Hebrew ). China 
(in -school imputation), and Fortalesa (restricted grades), scored well in 
this topic compared with their performance overall, while Entilia- 
Romagna. Canada, and Maputo- Beira (in-sehool population) achieved at 
relatively lower levels than they diii in mathematics in general. Except for 
Switzerland ( IS cantons). high-|>erforming populations tend to emphasise 
Algebra and Function* a lot. However, some lower-|>crforming populations 
also emphasized this Ur/w: Spain (except Cataluna ). Portugal (restricted 
grades). Sao Paulo (restricted grades), and Fort aleza (restricted grades). 
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Mathematics. Age 13: 

Sample Test Collections for Aigebn. 
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Mathematics, Age 13 

Percentages of Schools that Emphasize Algebra 
and Average Pereents Correct for Algebra* 
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aiTliaaflCSMOCiSlis In looking for ways to improve students 41 mathematics 
performance, more and more educators are focusing as much on the 
mathematical processes that students must use as on the content of the 
specific topics* Mathematics specialists in many countries are now 
recommending that teachers increasingly focus on process skills through 
problem-solving, communication, and reasoning tasks. 1 * 

In an attempt to reflect these emphases. IAEP participants decided to 
include questions at three levels of cognitive processing: Conceptual 
Understanding, Procedural Knowledge, and Problem Solving. In the 
age 13 assessment, about one-third of the questions fell into each of these 
categories. 

Questions classified as Conceptual Understanding required students to 
exhibit an understanding of mathematical facts and concepts — for 
example, number facts; properties of measurement; geometry concepts: 
properties of charts, graphs, and tables; concepts of statistics and 
probability; and the conventions of algebraic expressions and equations. To 
complete Procedural Knowledge tasks, students had to apply knowledge anil 
concepts in solving routine problems, typically following standard 
procedures taught in the rlassnNwn. Problem-Solving tasks required the 
application of several skills to a unique situation. These tasks typically had 
to be solved in multiple steps. 

It is difficult to know exactly what processes students with differing 
backgrounds use to solve problems. A problem may require simple recall 
from a student who has studied the topic and may require problem-solving 
skills from another student who has had no experience with that type of 
task* Questions were assigned to the three process levels on the basis of 
expert judgment of typical approaches used by students at the target age 
levels • 

FIGURE 2. 12 presents the results for the two population groups for 
the three types of mathematical processes. Also re|>orted is the percent of 
students in each location who agreed with the statements that ^learning 
mathematics is mostly memorizing" and that "knowing how to solve a 
mathematics problem is as important as getting the right answer." This 
background information provides the students' 1 perspectives on the 
importance of more routine mathematics skills versus problem solving* 



18 for example, in the United Stales, nee Carrvttdum and Evaluation Standards for School 
Mathematics. Reston. VA. National Cotrorii of Tearhers of Matberaatim. 1999. 
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In ell populations, the vast majority of student* (usually more than 
75 |>errent ) agreed that problem solving is important. Nevertheless, in 10 
imputations, about one-half of the students believed that learning 
mathematics is mostly memorizing. The pattern of responses does not 
coincide with high and low achievement. For example* most students from 
Korea and China (in~»ehool population) did not view mathematics as a 
memorizing task, while many students from Taiwan and Hungary did. 

The patterns of performance for all three process categories in the 
assessment generally match those for the mathematics assessment overall. 
The only exception is Maputo- Beira (in -school population)* where students 
scored relatively higher in Conceptual Understanding and lower in 
Procedural Knowledge than they did overall. 
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titfoiaaici op tmi can AOI ii population The performance of the 
Canadian population* in each of the content and process categories, 
presented in FIGURE 2*13. mirrors their performance overall with only a 
few exceptions. Saskatchewan (French) performed better in Numbers and 
Operations compared to its performance overall; New Brunswick (English) 
scored relatively higher in Measurement than it did overall; and Quebec 
(French) demonstrated higher achievement in (Geometry compared to its 
achievement overall. Like Canada as a whole, u number of provincial 
populations scored relatively higher in Data Analysis. Probability, and 
Statistics than they did overall: Alberta. Saskatchewan (English), Nova 
Scotia. Ontario (English). Manitoba (English), and Ontario (French). Also, 
five Canadian populations — Quebec (French). Alberta. Ontario (English), 
New Brunswick (English), and Ontario (French) — j>erformed lower in 
Algebra ami Functions compared to their performance on all mathematics 
questions. This pattern was also seen in Canada as a whole. The 
achievement levels of the Canadian populations in each of the process 
categories were relatively the same as their levels overall, except for New 
Brunswick (French) which scored lower in problem wiving compared with 
its achievement on all mathematics questions. 
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COMICBIBM BOIS Sill ft •ifflBIflCI The mathematics experts from all 20 
countries agreed on the topics to be measured hy the teste for 9- and 13- 
year-olds just as they did on the individual test questions that were 
included in the assessment. While the instruments were not perfectly 
aligned with any single country's curriculum, they were deemed to he 
appropriate for all. 

Most 1AEP countries still emphasize basic whole number operations 
at apse 13* Many countries that emphasize geometry and algebra a lot 
performed well in those topics as well as in mathematics overall. Taiwan, a 
high performing population, is an exception; its schools do not emphasize 
geometry at this age level. Spain (except CatalufiaK Portugal (restricted 
grades)* Sao Paulo ( restricted grades), and Fnrtaleza (restricted grades) all 
emphasize algebra a lot and yet are lower performers. The shift to more 
advanced content may suggest an effective strategy for challenging 
students, for presenting more interesting aspects of mathematics, and for 
underlining high expectations. 
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in classrooms around the world, teachers apply their knowledge 
ami skills, employ a variety of teaching methods, make use of 
available instructional materials, anil organize their 
Indents for learning* International comparative studies offer 
unique opportunities to compare ami contrast the ways in which 
teachers do these things ami to relate them to student |>erformance. 1AEP 
coflecteil information about some of these elements from the students who 
participated in the study and from their school administrators* 

The results reported in this chapter reflect the {lerreptions of those 
students and administrators of their school situations. Responses of others 
— for example, teachers or curriculum expert* — might provide a 
different picture of classroom*. Because the nature of schooling differs 
from country to country — for example, the length of the school week* the 
number of days of mathematics instruction each week, the ways various 
instruetional practices are used in the classroom — the student and school 
background «juest*ons may take on different meanings from population to 
population. Possible differences in interpretation are suggested in the 
following discussion of results. 



I ■ 6 rlaCTldf Teaching practices vary from country to country; in some 
instances, there is even greater variability among regions within a single 
country. In the hands of a gifted, caring teacher, the particular methods 
used may be immaterial. Nevertheless, educational experts often promote 
certain techniques as more effective than others. The descriptive data 
collected in IAEP highlight the variation in teaching practices across 
countries. Some of the results are summarized in FIGURE 3.1. 

School administrators in mi»st populations reported that their schools 
spent Iwtwcen 200 and 250 minutes a week (typically. 40 to 50 minutes a 
day) on mathematics instruction in the grade in which most 13-year-olds 
were enrolled. The average was more than 250 minutes a week in the Soviet 
Union ( Russian-speaking schools) and more than 300 minutes a week in 
China (in-school population). Schools in Korea. Hungary. Ireland. 
Slovenia. Jordan, and England (low partici|>ation ) spent less than 200 
minutes a week on mathematics instruction. 

Students in many countries regularly s|»ent their instructional time 
listening to mathematics lessons. In 12 populations, more than half the 
students rc|Mirted that they listened to their teacher give a mathematics 
lesson every day. The populations reporting less frequent use of teacher 
presentations were Korea. Hungary. Emilia- Komagna. Israel (Hebrew). 
Scotland. England (low participation). Portugal (restricted grades), S5o 
Puulo (restricted grades), and Kortaleza (restricted grades). In some 
participating countries, students did not necessarily have a mathematics 
class every day anil some students probably interpreted "every day" as 
every school day while some may have interpreted "every day" as every 
mathematirs class. 

Another common clasNr*»om activity is to require students to work 
mathematics exercises on their own. While the most prevalent response for 
students in most locations was that they worked inde|»cndently "several 
times a week." about one-half of the students in Switzerland ( 15 cantons). 
Canada. Scotland. Ireland, the United States, and Maputo-Beira (in-school 
population ) indicated they did exercises on their own in mathematics class 
every day. as did about three quarters of the students in China (in-school 
population). In some locations, students did not necessarily receive 
instruction in mathematics every day. anil students* interpretation of 
"every da,*** may have varied. 
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More and more mathematics educator* are recommending the use of 
group work an a method for developing problem-solving skill*." 
Nonetheless, this activity was practiced less frequently in IAEP countries 
than teacher presentation or independent work. The majority of students 
in only 10 populations said that they solved problems in small groups 
during mathematics class at least once a week. The practice was used most 
often in Emilia- Komagna. Jordan, and Maputo- Bcira (in-*chool 
population). 

Testing practices vary considerably from country to country. Some 
countries rely on short-answer and essay forms of testing, others use 
multiple-choice formats almost exclusively, and some administer tests on an 
irregular basis.*' The IAEP results indicate that most participants were 
infrequent users of mathematics tests and quizzes. The exceptions are 
Taiwan and Maputo- Bcira (in-school population), where between 85 and 95 
percent of the students reported taking mathematics tests or quizzes at 
least once a week, and the Soviet Union ( Russian-speaking schools), 
France. Canada, the United States, Jordan. China {in-school population), 
and Fortaleza (restricted grades), where at least 50 percent of the students 
reported being tested at least once a week. 

Doing more homework is often cited by educators and parents as a 
means of improving academic performance. Many factors contribute to the 
effectiveness of homework as an instructional activity: the types of 
assignment, whether or not the homework is discussed in class, and 
whether or not it is graded.- 1 IAEP results indicate that most students in 
most populations do not *|>cnd a great deal of time doing mathematics 
homework. The most common response of students in most participating 
countries was one hour or less each week. Only in Korea, and Israel 
(Hebrew) was the norm higher, two to three hours per week and in China 
(in-sehool population) the most common response was 4 hours or more 
each week. One-third or fewer students reported doing four hours or more 
of mathematics homework each week (at least 45 minutes a night), except in 
China (in-sehool |M>pulation). where the {>er< rentage was 37. 



*'*Mril llavtiltmt. "Intmdwlion ami IK#»rv»rw.~ Omtprruliw l*»nrntm# in Mathematics m N#**J 
DaviiifKin* Ktiiiur. MrrUi* Park. C A: \diH*i<«i -W^lry l*ulili»hing (luififiany. IWO. 

-^HHiner K. Madau* ami Thoraa* krlla^han. Student Examination Syxtvm* in th*> Earnfieun 

(lommaaiiy: I^sjums fur the I nited State*. Conlrartur* K**|M>rt. Ofilrr uf TWhnoltt^y \.s*t**»nw»nt. 
L'tutift Siatr* Ooftftrpft*. IWI. 

-^Herbert J. Waibrrg. Svirthe»tK «f Rt**#*arrh tut Ttmr ami i^arnin*. Educational hpodrrthip* 
Vol. 4&. S». 6, Marrh l*#Ui. 
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The finding describing teaching practircs highlight the variation in 
practices among countries anil do not identify any particular practice that 
is rommon to all high-performing populations. On the contrary, in all 
cane*. l>oth high- anil low-achieving populations had high values on alt of 
the variable** examined. This laek of strong interpretable patterns 
underlines the importance of examining other factors to understand 
differences in f*****fbrmanrc — for example, students* home environments, 
the countric cultural factors, and the structure of their national 
education systems. These will In* discussed in subsequent chapters. 

While the information presented in FIGURE 3.1 does not show cross- 
population trends, it is ftossihlc to find more consistent relationships 
Iwtwecn classroom variables and mathematics achievement within 
individual participating countries. Analyses of this tyjw are summarized in 
FIGURE 3.2. If the linear relationship between increasing levels of a 
particular variable and aehievement within a imputation is positive, a 
is shown: if the linear relationship is negative, a is shown: and if a 
significant linear relationship does not exist* a '*0" is shown. 22 For 
example, if the students in a particular |>opuIation who spent more time on 
mathematics homework tended to do better on the assessment than their 
fellow students who sjw*nt less time* a aojiears for the population in the 
homework column: if the students who worked in groups in mathematics 
class more frequently tended to do less well on the assessment than those 
who did so less frequently, a apj>cars in the group work column. 

While for most factors* similar trends are seen in more than one-half 
of the participating countries, there are always at least one or two counter 
examples. In most populations, students rrjHirtcd relatively high 
frequencies of teacher p.* station and inde|H*ndent work and lower 
frequencies of group work. Gurrent research in the United States indicates 
that classroom instruction is often dominated by teacher lectures, 
traditional workbook and text book materials that is mostly drill-and- 
practice ami that little time is left for students to participate actively in the 
learning enterprise/ 24 
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^ John lwfinttand..4 Mare Called Schooi. New York; MrGraw dlilL IWt. 

Iri* R. Wet**. Ktffort fjf thp l9ft>Hb Sa&nnai .Wv t>fScu *r#» on*/ Mathvmatic* hturatmn. Research 
Trianrfp Park. NCI; Re*w4iTiian*Je Institute. 1987. 
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Mathematics, Age 13 

Relationship of Classroom Factors and 
Average Pereents Correct within Populations 
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1AEP results indicate that teacher presentations and independent 
work are not negatively associated with performance within most 
populations. In more than one-half of the populations* performance is 
positively related with frequency of teacher presentation and independent 
work and negatively related to frequency of group work. The positive 
relationships between performance and teacher presentation and 
independent work may reflect the beneficial effects of more frequent 
mathematics instruction in general or of more frequent use of these specific 
practices. The negative relationship between performance and group work 
is harder to interpret because grouping is used for a variety of purposes* 
such as cooperative learning tasks or remedial work, and in some 
countries, grouping is only used infrequently. 

The descriptive results suggest that testing was relatively infrequent 
among most 1AEP participants, ami even among those countries that use 
testing more frequently — Taiwan* the Soviet Union (Russian-speaking 
schools), France, Canada, the United States, Jordan, China (in-school 
population), Fortaleza (restricted grades), and Maputo-Beira (in-school 
population) — the relationship between testing and performance is not 
consistent. In some cases relationships are positive; in some, negative; and 
sometimes there are no discernable relationships. 

In more than half the populations, time spent on mathematics 
homework is positively related with achievement. This is the case for most 
of the participating countries where between 20 and 40 percent of the 
students reported spending four hours or more on mathematics homework 
each week; Korea, Taiwan, the Soviet Union (Russian-speaking schools), 
Spain (except Catalufla), and China (in-school population). On the other 
hand* time on homework is not associated positively or negatively with 
achievement in Emilia-Romagna, where mathematics homework was quite 
prevalent. 

Results about time spent on mathematics homework and mathematics 
performance, which are summarized in Figures 3.1 and 3.2, are provided in 
detail in FIGURE 3.3. This figure gives the percentage of students who reported 
spending various amounts of time on mathematics homework each week — 
0 or 1 hour, 2 or 3 hours, 4 or more hours — and next to each category the 
average percent correct on the mathematics assessment is indicated by a bar. 

The figure demonstrates that in the majority of the populations, 
achievement increased (i.e., the baro become longer) as time spent on 
mathematics homework each week increased. The increase is significant in 
14 populations. The differences in the length of the bars shows the 
magnitude of the increase and the percentages of students in each category 
indicate how many students are represented in the increase* 
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For example, in Korea there is a mi nleratc increase in performance 
for students who »|ient two to three hours weekly on mathematics homework 
(38 | >errent of the students), ami an additional flight increase for students 
who spent four hour* or more (33 percent of the students )• In Taiwan* the 
increases were much greater for lioth groups of students* hut fewer 
students spent these amounts of time on mathematics homework each week: 
29 percent for two to three hours and 24 percent for four hours or more. 



TI ACS t MS ■ ATI 1IMS As the use of technology increases around the world, 

mathematics educators are advocating the use of calculators, computers, 
and hands-on activities in the mathematics classroom. The IAEP data 
presented in FIGURE 3.4. however, indicate that for most participating 
countries, these teaching materials were not yet a part of regular 
instruction. 

Use of mathematics tools — counting blocks, geometric shapes, and 
geometric solids — to teach mathematics concepts is common in the 
elementary grades. However, the IAEP results suggest that these kinds of 
hands-on activities were used infrequently with 13-year-olds, not 
necessarily because they are inappropriate for older students but perhaps 
because materials are not available or because of time limitations. Only in 
Sloven a and Maputo-Beira (in-school population) did a majority of 
13- year -old students report using mathematics tools at least once a week. 

While in most populations, large percentages of students owned 
calculators, they did not always use them in school. Ownership of 
calculators was common in all countries except Korea. China (in-school 
population), and Maputo-Beira (in-school population), where less than 25 
percent of the 13-year-olds had them. Use of calculators in school was very 
common in France, Scotland, and England (low participation), where more 
than 80 percent of students reported their use. but less so in the remaining 
participating countries. More than one-half of the students in 12 
participating populations indicated that they never use a calculator in school. 

As might be expected, computer use was even more infrequent than 
calculator use. The majority of students in 18 populations reported that 
they never use a computer for school work or homework. Only in France, 
Israel (Hebrew), and Slovenia did the majority of students report ever 
using a computer in this way. In almost all populations, school 
administrators reported having very few computers that 13-year-old 
students could use for school work. Only three populations had, on 
average, 20 or more computers in schools that students could use for 
instruction: Scotland, the United States, and England (low participation). 
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riACRlt •ACtetosaa *■» ciassioe* 08«A«tl*?i»i Two additional 

classroom variables are often studied by educational researchers: teacher 
background and classroom organization. The information IAEP collected 
from participating schools on these topics is presented in FIGURE 3.5. 

School administrators were asked if students in the modal grade for 
13-year-olds (typically grade 7 or 8) are taught by a person who teaches 
mathematics most or all of the time; in most populations, schools 
overwhelmingly responded "yes." The exceptions were Switzerland (15 
cantons ), Hungary, Emilia-Romagna. and Canada, where about SO to 85 
percent of the schools reported that the regular classroom teacher taught 
mathematics along with several other subjects* Schools also reported the 
percentage of seventh or eighth grade mathematics teachers who had taken 
some post-secondary mathematics courses other than courses in 
mathematics instruction. Advanced mathematics training was close to 
universal in Hungary and Slovenia. All or almost all schools in these 
populations indicated that all their mathematics teachers had had this type 
of preparation. More than half the schools in the Soviet Union (Russian- 
speaking schools). Scotland. Ireland* the United States. Jordan. England 
(low participation). Sao Paulo (restricted grades)* and Fortalesa 
(restricted grades) reported that all of their mathematics teachers had 
taken at least some post-secondary level mathematics courses. 

The efficacy of grouping students by ability is strenuously debated 
and grouping practices van* from country to country, as shown in 
Figure 3,5. While assigning students to mathematics classes by ability may 
give teachers an opportunity to gear their instruction to the specific 
achievement level of their students, it may also mean that some students 
are exposed only to lower-level content and skills while others are exposed 
to a more enriched curriculum. 21 Among IAEP participants, five countries 
were likely to organize mathematics classes on the basis of ability: Taiwan. 
Israel (Hebrew). Ireland, the United States, and England (low partici- 
pation). More than half the schools in each of these locations reported this 
practice. The remaining countries organized their classes by ability with 
less frequency. 



-4 Jranroe Oake*. Unequal i>pportumues: The Effects of Roe*. Social Class, ami Ability Grouping 
and Access to Science and Mathematics Education. Pate Aho« CA: The Kami Corp.. 1989, 
Jeanne Oakes. Multiplying inequalities: The Effects of Race. Social Class, and Ability Grouping 
4m Students' Opportunity to l^earn Mathematics and Science. Santa Mroitra, CA: The Rand Corp.* 
19W. 
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WHAT WOlftS 11 THE CLAfSlOOM While classroom factors impact on student 
performance more directly than do home and swietal variables* 
relationships between these variables and achievement were not consistent 
acros* the participating 1AEP countries, reenforring the notion that 
effective instructional practices may vary from culture to culture. 

Generally* the results suggest that typical current practices — 
frequent use of teacher presentations and independent work — were 
effective. It is too early to tell if techniques that are now just being 
introduced into classrooms, such as working with small groups on problem 
solving, using mathematics tools, and using calculators and computers will 
make significant contributions in the future, once their implementation is 
perfected. 
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Students and Their Homes 



Moat things are easy to learn 
hut hard to master. 

(ihineM- IVoverli 



The rhetoric of politicians and the realities fared by educator* are 
often at odds with one another. The image* of happy, loved, 
motivated children arriving at school ready to meet the 
challenge* of the flay conflict with the sometimes harsh 
realities of poverty, child abuse, drugs, and crime that also 
manage to pans through the schoolhouse door Teacher* ami school* are 
asked to reconcile these conflicting views* to accept children with a wide 
range of abilities and readiness, and to transmit to them the knowledge, 
nkills. traditions, and values held dear by the sm'iety. 

To find out more about the background of the students in the 
assessment and to provide a broader context for the achk vement results, 
IAEP collected descriptive information about the students themselves and 
their families. Some of the background questions were included because 
they tap some of the inevitable variation in social and economic advantage; 
others explored some t>f the ways in whit h families, rich and poor alike, 
may foster academic development. Finally, a number of questions 
examined how students spend some of their time outside of school, in ways 
that may enhance their in-school performance. 



■ ONI ClAt ACTItlSTICt Information on the language spoken in the home, size of 
family, and the number of book* in the home ran provide indications of 
students* social and economic advantage as well an of other factors that 
might contribute more directly to their academic development. Language 
minority groups are often at a disadvantage within a dominant culture, and 
students from these families have the further handicap of receiving 
instruction in a language that is different from that which is spoken in the 
home. Size of family is often negatively correlated with disposable income, 
and students from large families may receive less individual attention from 
parents than those with fewer brothers and sisters. The number of books in 
the home is considered a general indicator of social and economic status 
and their presence also provides children opportunities for expanding their 
academic horizons. 

The IAEP data related to these socioeconomic and academic factors 
are displayed in FIGURE 4.1. The percentages of language minority 
students participating in the assessment arc low in all of the populations. A 
number of participants excluded language minority students from their 
namples or excluded geographic areas where large numlters of language 
minority students live ./More than 10 percent of the students living in 
Switzerland ( 15 cantons), the Soviet Union ( Kusstan-speaking schools), 
Emilia- Romagna. Israel (Hebrew). Canada, and Maputo- Bcira (tn-school 
population) reported that a different language from the one used in school 
was »poken at home. Some of these students had no choice but to attend 
schools where instruction is provided in the dominant language. Others 
could attend school* that teach in different languages and could choose an 
instructional program given in a language other than that spoken in their 
homes. 

The IAEP results indicate that family *ize is relatively small in most 
industrialized nations. Only in Jordan and Maputo-Beira (tn~school 
population) did large percentages of students indicate that they were part 
of families with four or more brothers or sisters. 88 {terrent in Jordan and 
64 | percent in Maputo-Beira (tn-school population). Ireland is unusual 
among its European neighbors, with one-third of its students corning from 
large families. 

Responses to the question on the number of hooks in the home also 
differed between more and lews industrialized participating countries. 
Close to one-half of the students from Jordan* Sao Paulo (restricted 
grades)* FortaJeza (restricted grades), and Maputo-Beira (in-srhool 
population ) reported that they had fewer than 25 hooks at home. In most 
other IAEP populations* fewer than 25 jierrent of students fell into this 
category. 
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paitiTAl mvoiviMIUT The home characteristics just discussed may be viewed as 
proxies for socio-economic indicators and also as variables that contribute 
to academic development. Parental involvement can have an important 
impact on a child's success in school regardless of the family'* social or 
economic Hiatus. When asked if they thought their parents wanted them to 
do well in mathematics, almost all students in each population gave positive 
responses, Agreement ranged from 97 percent in Israel (Hebrew) to 79 
percent in Portugal (restricted grades). 

However, when students were asked if someone at home talked to 
them about their mathematics classes, the responses varied considerably 
from fmpulation to population. Only 5? percent of the Korean students 
indicated that their parents asked them about their mathematics clashes, 
while H9 j percent of the students from Maputo- Beira (in-school population) 
reported this type of parental interest. 

Parents were more likely to ask their children about their 
mathematics classes than to help them with their homework. Parental help 
with homework was less prevalent in the Soviet Union (Russian-speaking 
school*). Emilia- Romagna. China (in-school population), anil Portugal 
< restricted grades), with fewer than 40 percent of their students reporting 
this ty j>c of attention. Hungary was highest with 80 jterrent of its students 
indicating that their parents helped them with homework. 

ftf IAT lONSJHF 0* B0MI CBAlACflif SflCS AMD AITAEMUKS FilFOIMAttCI 

The descriptive data about home characteristics show some predictable 
variation between industrialized and non-industrialized countries and 
contribute to an understanding of low performance among some of the non- 
industrialized countries. 

These trends are further substantiated when home characteristics 
are examined in relationship to achievement within individual populations. 
FIGURE 4.2 provides this type of analysis. For each population, it 
indicates with pluses, minuses, and zeros whether the relationship )>etween 
increasing levels of a particular home-related variable and mathematics 
achievement is positive, negative, or not related in a linear fashion to a 
statistically significant degree. 

The importance of socioeconomic factors is confirmed by the within- 
population results. Mathematics achievement is positively related with 
number of books in the home in all hut one participating population and is 
negatively related to family size in 15 imputations. 
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The data about parents are more difficult to interpret. Interest in 
their children's academic performance was fairly universal among parents 
in all of the participating countries. The level of parental involvement was 
high in some high-performing countries, such as Hungary but not always* 
Korean students, for example, reported relatively low leveb of mathematics- 
related discussion at home and help with mathematics homework. Within 
individual populations, parental attitudes toward mathematics was 
positively related with achievement in only eight instances. 

V OBT«Of »SC!001 ACTIflfllS While education is often cited as the 
dominant responsibility of school-aged children, young people actually 
spend much more of their time outside of school. Some of this out-of-school 
activity is clearly directed at furthering academic development — for 
example, doing homework and leisure reading. However, time spent 
watching television may or may not be supportive of learning. 1AEP asked 
students how much time they spent in these non-school activities and 
probed their attitudes toward mathematics as a subject area. These 
descriptive results are presented in FIGURE 4,3. 

While reading for fun is not on the face of it directly related to 
mathematics performance, consistent readers tend to l*e high achievers in 
many academic* areas. The percentages of students reporting reading for 
fun almost every day varied across participating countries. The lowest 
percentage of daily readers was in Korea. 1 1 jiercent. and the highest 
(percentage in Switzerland { 15 cantons), 51 percent. 

Populations varied more in the amount of time students spent doing 
homework across all school subjects each day. The most common resjmnse 
of students in a majority of 1AEP populations was one hour or less of home- 
work each school day across all school subjects. In eight populations, one- 
half or more of students reported doing two or more hours of homework 
each day. Students from Emilia- Romagna sfient the most time doing homework, 
with close to 80 percent reporting two hours or more of homework daily. 

Some television programming is clearly targeted at developing the 
academic abilities of children* and some countries provide more of this 
type of television than do others. However, for many students, the content 
of the television watched has little academic value and consumes valuable 
hours that could be devoted to activities requiring more intellectual effort. 
Among all but two of the populations, the most common response of 
students was two to four hours of television viewing each school day. Sixty- 
five percent of the Chinese students {in-school population) reported 
watching one hour or no television on a daily basis, probably reflecting the 
fact that many of these students had only limited access to television. Just 
over 50 percent of the students from France reported watching one hour or 
less of television each day. 
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At the other extreme. 20 percent or more of 13-year-olds from Israel 
(Hebrew). Scotland, the United States. Fortaleza (restricted grades), and 
Maputo-Beira (in-arhool population) indicated they watch five hours or 
more of television each school day and 19 perrent of their peers from 
Sao Paulo (restricted grades) and 17 fiercent from the Soviet Union 
{ Ru»stan-*|>caking schools) also reported heavy television viewing. 

ATT ITU 01$ TOWARD MATi HIATUS Students bring to sr html certain attitudes 
toward etlucation in general and toward s|iecific school subjects, These 
attitudes contribute to, and are a product of* academic success. Students 
who approach a school subject enthusiastically are more likely to do well in 
that subject: conversely, students who succeed in a content area are more 
likely to develop positive attitudes towanl it. 

Students in the assessment were asked to what extent they agreed 
with the following statements: 

• Mathematics is useful in salving everyday problems. 

• It is important to know some mathematics in order to get a good job. 

• / am good at mathematics. 

• Wy /parents want me to do well in mathematics. 

Their responses were combined to form an index of attitudes towanl 
mathematics: students were rategnrijeco as generally expressing positive, 
negative, or neutral attitudes* 

As shown in Figure 4.3, the majority of 13-year-olds in participating 
countries expressed positive attitudes towanl mathematics, with C XI |>ercent 
or more of the students from Israel (Hebrew). Canada, Scotland, the 
United States, and England (low participation) giving favorable response*. 
Curiously, fewer students from a numiwr of high-|>crforming populations 
— for example. Korea. Taiwan, the Soviet l ? nion (Russian- sftcaking 
schools), and China (in-school population) — exhibited punitive attitudes 
toward mathematics, but still, between 70 and BO perrent gave positive 
responses to these questions. Students from Jordan, a lower performing 
group, also fit into this range* 

Rf lATIOftf HIP Of HOMI JtCTIVITlIS AID MATHEMATICS Mtf©**A»CI 

An examination of the relationship between home activities and 
mathematics performance within populations confirm* the tm|>ortanre of 
bow students spend their time outside of school. For each imputation. 
FIGURE 4.4 indicates with pluses, minuses and zeros whether the 
relationship between achievement and increasing levels of a particular 
home-activity variable is positive, negative, or not related in a linear 
fashion to a statistically significant degree. 
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There is a positive relationship between leisure reading and 
mathematics achievement in 14 populations. Time spent on homework 
across all school subjects is positively related to performance in 13 
populations, and the amount of time spent watching television is negatively 
related in 10 populations. Positive student attitudes toward mathematics 
are related to higher mathematics performance in 1 1 populations. 

Results about time spent watching television and mathematics 
performance, which are only summarized in Figures 4.3 and 4.4. are 
provided in detail in FIGURE 4.5. This figure gives the percentage of 
students who reported spending various amounts of time watching 
television each day — 0 to 1 hour. 2 to 4 hours. 5 or more hours — and 
next to each category, those students' average percent correct on the 
mathematics assessment is indicated by a bar. 

The figure demonstrates that in many populations, achievement 
decreased (i.e.. the bars become shorter) as time spent watching television 
each day increased. The decrease was significant in 10 populations. The 
difference* in the length of the bars show the magnitude of the decrease, 
and the pcnrcwtages of students in each category indicate how many 
students are represented in the decrease. For example, in Korea. 
|M*rfomiance decreased substantially among students who watched two to 
four hours of television each day (65 |>errent of the students) and again 
among students who watched five hours or more each day (11 percent of 
the students). It is also possible to see from the bar patterns that the 
relationship between time s|»ent watching television daily and mathematics 
performance is positively related in two populations: Portugal (restricted 
grades) and Sao Pculo (restricted grades). 
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Til SC1001I08S! #001 The factors influencing learning are not 
restricted to school variables. Family and out-of-school activity play an 
important role in promoting in -school success. Some aspects of home life, 
such as number of books in the home and family sise. are often cited as 
indicators of social and economic advantage and in 1 AEP these variables are 
related to mathematics achievement in predictable ways. These factors help 
explain low performance in some non-industrialized countries, but do not 
suggest why some countries appear to succeed in spite of difficult conditions. 
Perhaps parental involvement, which can influence a child's academic 
performance regardless of a family's socioeconomic status, is another 
element that should be considered. Significant amounts of parental 
involvement were found in some high-performing 1AEP populations but not 
in others. 

What students do with their time after school seems to be another 
important home factor that affects academic performance. In many IAEP 
populations, high matbemati* s performance was assoe : «tted with large 
amounts of time spent on leisure reading and mathematics homework and 
small amounts of time spent watching television. Trends were not consistent 
across all populations, however, which suggests once again that these factors 
may operate differently from culture to ruhu.e. 



SWITZERLAND March 22. 1991 

It was snowinq. And it should haw hern. We drove right into a Christmas card. 

We got to the small French city the way you get anywhere in Switzerland: by climbing 
over a mountain. At 1.1MH) meters, our hill was not "serious" in Swiss terms, but these were 
only the Juras. not the Alps. It was u 15-minute drive from the lake at Meuchatel. 

The secondary school was steel and glass and obvious among all the other traditional 
buildings* The thirty-year-old math teacher who welcomed us tcarmly was an Ernest 
Hemingway look-alike* with a large bushy mustache. Affable and pleasant, he was none- 
theless worried that some of the students about to take the test had been transported from 
other schools that morning and would therefore, "not feel at home*** during this important 
event. 

The classroom, large, bright, ami airy, with clinical desks and chairs, featured an 
enormous poster of a sweaty Sylvester Stallone on the front wall. The rear wall bulletin 
hoarti was covered with frictures ofsftarts teams, action shots ofsiPccer plays, and a ample 
ofjMges from the Sftorts lllustratetl swimsuit etiition. 

Outside the nail of windows, the snow was falling heavily on the hillside forest across 
the street. As the assessment began. I concentrated on my quality-control checklist. 

"Were directions read VERHATIM?** The Swiss never do anything by the book. At least 
not by someone else's hook. Hut. he caveretl the essentials more than adequately. "Did the 
Cooniinator start on time?** What a question! The Motional Ol>servatary by which Switzer- 
land sets the official time for all of its clocks and watches is 10 kilometers from here. 

A hand goes up, 1 student asks a question. The teacher res/umds with a Gallic shrug. 
The manual says nothing about Gallic shrugs and they can he fmwerfutly expressii*e. What 
to do? 

The teacher whisjters to me that this kind of test f multiple-i-hoice] is OK once in a 
while, but if given /iw> often, it could njfect the way teachers teach. I agree with him. All of 
the students finish Itefare time is culle*! and declare victory. 

After the event, the students crowd around to ask quest urns. 

"Is this the kind of test Americans take?** "Yes. And this month your ctdleugues in 
London. Budapest, and Taipei are answering these very same questions. "Sans blagues!" 
f\o kidding!} "W here do you live?** *\\Wir \ew York City.** "Wow. really? Can I come and 
visit you?** "W hen will we know the results?** 

Most of them will graduate from this school to the technical institute 
next tloor. A few may go on to Ite engineers. Most will s/>end their lii*es 
in this canton. 

At the end. each of the 2(> walks over to shake my hand and 
say. "Merci. Monsieur." These 13-year-olds thanked me for 
the privilege of taking a test! On the way Imck. the 
\ational Cooniinator explained how each and every 
canton does its own thing Wurriculum. test Inmks. 
examinations, and teacher certification f. We stop/ml to 
see an enormous statue of a Reformation hero, who devotetl 
his life to breaking statues. There s a lesson there, somewhere. 

ETS Quality Control Observer 
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While it in difficult to tie global different »e* in social, cultural, and 
economic frameworks to the mathematics performance of students, 
throe factors clearly play a role in determining the 
characteristics of education systems. Each count* < makes 
decisions about the education of its citizens and the roles schools 
play in strengthening the national identity and economy* These choice* are 
rooted in the physical, demographic, and socioeconomic characteristics of 
the country as well as in its it values and cultural traditions. 



COUNTRY CHAIftCTIttSftCS The countries participating in 1AEP represent a 

broad range of physical, demographic, and socioeconomic characteristics: 
large anil small, homogeneous and heterogeneous, urban and rural, and 
rich and poor. Some of these characteristics are presented in FIGURE 5. 1 ; 
these data reflect the participating countries in their entirety ami not just 
the republics, p.ovinee*. or cities that were sampled in the survey. 



While most of these country characteristics are not directly related to 
the achievement of 13-year-old students, they provide an important context 
for understanding the relative performance of participants. China, the 
Soviet Union, and the United States are the largest populations involved in 
IAEP with about 1.1 billion. 300 million, and 250 million people, 
respectively. Alongside these pants stand the 2 million citizen* t>f Slovenia* 
3 million of Jordan. 3.5 million of Ireland, and 4.5 million of Israel. 
Clearly, large and small countries face different problems in the 
administration of national educational programs. 

The degree of a country's cultural homogeneity influences how 
educational program* are formulated ami implemented. Eleven of the 
participating countries have populations that are dominated by a single 
ethnic group: Korea. Hungary. France. Italy. Scotland. Ireland. Slovenia. 
Jordan. China. England, and Portugal. Similarities in language, religion, 
and values tend to reflect ethnic homogeneity. More than 10 percent of the 
population in the remaining countries comes from one or more ethnic 
minority groups. 

Most of the participating countries an* urbanized with industrialized 
economies. Ail but three of the countries* populations are at least 50 
percent urban* China. Portugal, and Mozambique are still predominantly 
rural, which must influence their orientation toward education. 

Among participants, variation in national wealth, as measured by 
|>er-capita g.*oss national product (in U.S. dollars), is startling and can 
sometimes explain and sometimes confuse our understanding of differences 
in mathematics performance. Among the jNmrest countries are 
Mozambique, the lowest-fterforming population, and China, the highest- 
performing imputation. In jier-rapita terms, thr wealthiest country is 
Switzerland, followed by the United States. Canada, and Fram e. 

Some countries compensate for limited resources by spending a 
greater shart of their wealth on education* Among the IAEP countries. 
Israel sj*ends the greatest jwrcent of gross national product on education, 
more than 10 percent. China spends the smallest |M*reentage. less than 
three percent. 

Statistics indicate that literacy rates are high in all IAEP countries 
except in Mozambique, where more than 80 parent of the adult population 
is still categorized as illiterate. Jordan. China. Portugal, and Brazil are the 
only other countries with sizable pockets of illiteracy, ranging between IS 
and 30 jwrrent. 
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Basic descriptive characteristics illustrate some of the grave 
ir blems that developing countries such as Jordan. Brazil, and 
Mozambique face in the education of their young people. The data, 
however, fail to explain why some poor, non-industrialized countries 
manage to achieve phenomenal success in education and why some rich and 
powerful nations fail to perform at the same high levels. 

foucinon 5 t s f f m s Differences in country characteristics are often translated 
into differences in education systems. Predominantly urban countries are 
more likely to have large schools and large classes. Countries with strong 
centralized governments tend to centralize educational policy as well. Poor 
countries have higher incidences of problems in their schools, such as 
overcrowding, inadequate facilities, and not enough textbooks. Some of 
these characteristics of education systems are summarized in FIGURE 5.2. 

Although countries vary with respect to the age at which children are 
required to start school, in most IAEP countries, children are six years old 
when they begin compulsory schooling. Children in Scotland and England 
start first grade earlier, at the age of live, anil those in the German part of 
Switzerland* parts of the Soviet Union. Slovenia, parts of China. Brazil, 
anil Mozambique do not atari until age seven. Countries also vary in terms 
of the availability of nursery schools and kindergartens and the degree of 
academic content in these programs, Furthermore, since academic 
development often proceeds along with physical and mental maturation, 
one cannot assume that, by age 9 or 13. students who started school at age 
neven are two years behind those who started at age five. 

Likewise, one must also be careful in comparing countries with 
respect to the number of days in the school year. In wany locations, 
festivals, sjrorts events, and other non-academic activities are integrated 
into the school-year calendar. Trying to get a more precise measure of time 
spent on school activities. IAEP asked school administrators to indicate the 
number of days specifically devoted to student instruction in the school 
year. The results are reported in FIGURE 5.2. Variation among 
participating countries is evident in this indicator as well. The average fot 
most populations is from 175 to 199 days a year. France. Ireland, and 
Portugal (restricted grades) provide fewer than 175 days of instruction 
annually. The average in China {in-school population) is dramatically 
higher (251 days), and Korea, Taiwan, Switzerland (15 cantons), Emilia- 
Romagna. and Israel (Hebrew) report averages from 200 to 224 days a year. 
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To obtain a full picture of instructional time, one needs also to know 
the number of minutes spent on instruction each school day, excluding time 
*|H*nt for homeroom, lunch, recess, study hall, or moving from class to 
class. Most IAEP countries devote, on average, about 240 to 360 minutes 
\ four to six hours) to instruction each day. France spends the most time on 
instruction. 370 minutes daily. Two population* provide less than 240 
minutes daily: Hungary and Fortaleza. 

While large class sizes do not hinder many tyjies of instruction, they 
do limit opportunities for individual attention, group work, and hands-on 
activities. School administrators in 10 imputations indicated that the 
average class size for the grade in which most 13-year-olds are enrolled is 
from 25 to 34 students. Schools in Switzerland (15 cantons), the Soviet 
Union (Russian-speaking schools). Emilia- Romagna. Scotland, the United 
States, ami England (low participation) have smaller classes, ranging from 
IS to 24 students. Very large classes of 45 or more students are the norm in 
Korea. China (in-school population), and Maputo-Bcira (in-seh'ml 
imputation), while classes average from 35 to 44 students in Taiwan and 
Sao Paulo ( restricted grades). 

Four I AEP countries encourage local or regional control over 
curricular matters: Switzerland (15 cantons). Canada, the United States, 
ami Brazil* which does not set the education programs for Sao Paulo and 
Fortaleza. Within this group, the United States is actively discussing 
centralization. 



The remaining countries have a national curriculum. In England (low 
partici|>ation), the centralization of educational goals and objectives is only 
two years old. In the other countries, a strong national ministry of education 
is a long-established tradition. 

School aclministrators were asked to what extent they face problems of 
overcrowded classrooms, inadequate facilities and maintenance, shortages 
of textbooks and other educational materials. Student absenteeism ami lack 
of discipline ami vandalism of school property were also surveyed. Their 
responses to eight questions listing these problems were combined into an 
index of serious problems. In only seven populations did at least one-half of 
the schools report one or more serious problems: the Soviet Union (Russian- 
speaking sehools). Slovenia. Jordan. Portugal (restricted grades). Sao Paulo 
(restricted grades). Fortalcza (restricted gra«lcs). and Maputo- Beira (in -tub is J 
population). 

II SOIUTIOI Kducation systems vary from country to country but not 
necessarily in patterns that explain high und low mathematics achievement. 
It does not seem to matter greatly whether students l»egin school early or 
late, and while some high-performing countries huve a longer school year or 
a longer srhi»ol day. these ihararteristirs were also present among some low- 
achieving groups as well. While no one would advoeate the l>encfits of 
increasing elass size, several education systems demonstrated sueeess despite 
large elass sizes. Finally, some nuintrics succeed while others do not. in 
some caws, in spite of serious problems in srhool. 



ITALY March 20, 1991 

The elementary school was in an industrial suburb of Bologna* The kids were playing 
outside as well as in a wry large open reception area right inside the front door. Excited 
voice-noises were magnified many times in this substantial echo chamber. An old, black- 
cassocked priest was collecting disciples for a doss in religion. 

A handsome* young principal greeted us enthusiastically and led us through the chaos 
toward a room upstairs. As we proceeded, strident soprano voices shouted "Ciao, 
IHrettore" ( Hi, Principal)! Each greeting was responded to with a smile, a wave* a pat 
on a head, a caress on a face. 

As the National Coordinator parted groups of children to create a passage for use, she 
stooped to kiss and hug, indiscriminately, these complete strangers. All of this with an 
easy casualness that caused no serums interruption in our fast-paced conversation con- 
cerning the new education legislation and its affect an the building arrangement. 

Thirty-four 9-year-olds from three different schools were arriving and beinp seated 
quietly after locating their name tags, previously put on each desk. Three teachers facili- 
tated the process. Booklets were passed out* instructions read, and questions solicited. 
Questions were answered, tasks begun, a little girl left the room to tend to something she 
should have thought of earlier. 

At the end of the test, the teachers handed out beautifully wrapped candies as a 
reward. At my request* the children were asked for reactions to the experience. Hands 
went up and were individually recognized: "BeUo! ( IS tee),** "Facile ( Easy)," "IXvertente 
{Fun)." 

The feelings were unanimous and enthusiastic. 

We said goodbye as the kids streamed through the door — a confusion of hand 
shakes, pats m "Crazies** and "Ciaos." A quiet moment was spent with the teachers, one of 
whom was vocal and emphatic that no group of human beings, especially her children, 
should be put through such a dehumanizing experience. 

My absentation to the National Coordinator about how pleasantly surprised I was to 
see all the easy demonstrations of affection between students and teachers elicited her 
own surprised reaction. 

"But why not? The children must know that they are most 
important and that they are loved. They must feel secure or 
they cannot learn. A school is a family!" Neat idea! 

I had promised the children of San Felipo that 
I would tell the world about them. 

This is a start. 

FTS Quality Control Observer 
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Performance of 9-Year-01ds 
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What we first learn we best ken. 

Scottish Pniverb 




Fourteen of the 20 countries participated in an optional assessment 
of 9-y ear-olds. Some countries sampled students from the entire 
age cohort within a defined population and others excluded 
some segments of the age-eligible population or had low school 
and student participation rates* The results for these two sets of 
populations are reported separately as comprehensive populations and 
populations with exclusions or low participation. 



OfllAll aATIIMAUCS MlfOIMAICl The average percent correct and 

distribution of scores for each population are presented in FIGURE 6.1* 
The green bars indicate the average percents correct and take into account 
the imprecision of these estimates due to sampling. When the bars overlap 
with one another, as they do in many cases, performance is not 
significantly different. 
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Mathematics, Age 9 

Distribution of Percent Correct Scores* by Country* 
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The shaded bare indicate the range of scores for the best students 
(those in the 90th through the 99th percentiles) and the range of scores for 
the lowest-performing students (those in the first through the 10th 
iwrcentiles). The average percents correct for students in the 5th and 95th 
|M»reentiles are marked by bullets within the shaded bare. 25 

The range of average percents correct across the 14 comprehensive 
populations and populations with exclusions or low participation at age 9 is 
20 points and in all of these populations, some students performed very 
well and others performed poorly. The difference between the highest and 
lowest performing groups was much greater at age 13, but when 
considering just those populations that participated in assessments at both 
age levels^ the difference was only 25 points. 

The average score across the comprehensive populations and 
populations with exclusions or low participation, represented by a vertical 
dashed line, is 63 |>ercent correct. 2 * Nine-year-olds in the Soviet Union 
( Russian -sjw-aking schools). Israel (Hebrew), Spain (except Cataiuna), and 
Kngland (l»w participation) performed about at the IAEP average. 

The highest-scoring population was Korea, with an average percent 
correct of 75. Other imputations {performing above the IAEP average, from 
higher to lowest* were Hungary* Taiwan. Emilia- Romagna (low partici- 
pation I. **nd Scotland (low participation). As the overlapping bars on the 
figure illustrate. |>erformancc of these four groups is essentially the same. 

The remaining population* scored below the IAEP average. These 
included, in order of average percent correct, Ireland. Canada 
(4 provinces), the United States, Slovenia, and Portugal (restricted grades) 
ami in many instances, when sampling error is taken into account, their 
|w»rformance levels are equivalent* 

Three Canadian populations scored at the I AEP average: Quebec 
\ French U <Juel>ec (English), and British Columbia. The remaining 
Canadian populations performed below the average: New Brunswick 
( English). Ontario (English), and Ontario (French). The range of scores for 
the Canadian populations is only 1 1 points and in many cases performance 
is equivalent from one population to another. 



Perf »raianrr of *tud*>m» at the very tmlloni nf th* diatribiitkm tthe low*! I pcrrcnt) and al ikr 
very top i the highest I percent) arc not represented on the Figure breath** very few *tt»denlJt fall 
into the*e rateaorie* ami their performance rannot iw estimated with precision. 
X>Th*> IAEP average i» the unweiajued average nf ihe htww of I he roioprehemiive population*. 
jMipuJatMms with eir hwioos or low participation, ami Canadian population*. An unweighted 
average wa» ehosen lo describe the midpoint because h i* not influenced by the differential 
weight* of very large and very small populations. 



Achievement reflects the percent correct on 61 questions. Responses 
to one question included in the assessment were removed from the results 
after a series of data analysis steps determined it was not functioning the 
.same way across all populations. 27 

MATHEMATICS FIIPfllMAICl IT 6IH0II The patterns of performance for males 
and females at age 9, shown in FIGURE 6.2. are not the same as those seen 
at age 13. The advantage of boys over girls is not evident in as many 
comprehensive populations and populations with exclusions or low 
participation at this age. Only in Korea. Israel (Hebrew), and Emilia- 
Romagna (low participation) did boys aged 9 significantly outperform 
girls. Performance levels of boys and girls was about the same in each jf 
the Canadian populations. 

The country results were not always consistent at the two age levels. 
While there were no gender differences at age 9 in Spain (except Catalunah 
Ireland, and Canada/* lmys scored significantly higher than girls in these 
three countries at age 13. The reverse is true in Korea and Israel 
\ Hebrew). Here, Imy* had significantly higher mathematics achievement at 
age 9 but jH»rformed about the same as girls at age 13. In Emtlia-Romagna 
(low participation K the pattern consistent; boys displayed significantly 
higher performance at both age levels. 

Figure 6.2 also indicates that most students in most populations 
agreed that mathematics is equally appropriate for hoys and girls. As was 
see'.i at age 13. only in Korea did significant numbers of students view 
mathematics as gender linked. Here. 25 percent thought mathematics was 
more for hoys anil 27 \ percent thought it was more for girls. 



-~See the Procedural Appendix, pp. 142-143. and thr IAEP Techntrul Report for a detatW 
dutruitaitfM) of fluster and differential item funrtiiminp anaiy*U. 

28 Fewer Canadian province* participated in the ¥-year-old a»«eftsmcnt. *o the group* are not Ktrictiy 
romparabif* at the two ages. 
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Mathematics, Age 9 

Percentages of Students Reporting Math Is Ktjualiy 
Appropriate for Boys ant) Girls and Average Percent* 
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MATlffMTICf TOPIC! «*» MOtlffIS Summaries of mathematics performance 
just bcpn to describe the variation that exists frcrn country to country. Of 
more importance to educators in a description of performance in the 
various mathematics content areas that are taught in school. While initial 
analyses of the IAEP data confirm that questions across all topics can lie 
legitimately summarised without masking important differences t>etween 
countries, results by topic categories do show some variation."** 

The results for stutlents a#e 9 are presented for five topics* which are 
listed in FIGURE 6.3 ulonjj with the number of questions in each category*. 
Three quarters of the question*, used a multiple-choice format and the 
remaining questions required students to write their answers on ,nrs 
provided. 



fituti Mathematics. Age 9: 

Numbers of ^hiestion* by Topic 
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The §>erformanec of the eoinprehensive jm potations and populations 
with exclusions or low participation in eaeh of the five topies is presented 
ir, FIGURE 6.1. The populations are listed in order of overall performance 
across all mathematics questions* The hars show the IAEP average across 
ail compreliensive populations and |topulations with exclusions or low 
participation as well as the average |»creents for eaeh imputation in each 
topic category. 

In general, the relative |>erformaiire of the two population groups in 
each of the topics mirrors their overall achievement in mathematics. This is 
evident by the fact that the liars ihat represent the topic averages for the 
(Herniations generally follow the same pattern as the wide bars that 
represent overall averages presented in Figure 6. 1 . 




\ ruunlr> -by-ii»pi<* inl«'rar!i*Hi analy Mm lining Harttjoin ami WonpV K-Mr an* f-hintt-r anaJy*** 
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remain r»Ht-ntiaily thr *aim* if a group of itrm* from a partirular topir or topir* %*rn» mni>*eil from 
ibv i»v**rali nummary m? asurr» Morp tirtatJ* of I hi* analy*i» art* proviiiwi in ihr I*rm*p«itsral 
•fcpprmiix. p. 1 12 and in thr IAHP Tnhnimt hrpttrt. 



The patterns of performance were examined to see if the achievement 
of a population in a particular topic area was different from its overall 
achievement and some exceptions were identified. Since the average 
difficulty leveb of the questions in the various topics and across all topics 
differ* performance was examined in relative terms: by comparing the 
difference between a population's topic average and the 1AEP topic 
average with the difference between the population's overall average and 
the IAEP overall average. 30 

The performance of comprehensive populations and populations with 
exclusions or low participation in Numbers and Operations, which 
constituted about 50 percent of the assessment* was relatively the same as 
that acros« all mathematics questions. In Measurement. 15 percent of the 
assessment, students from Korea and Spain (except Cataluna) scored lower 
relative to their overall performance. Ten percent of the assessment was 
,e voted to Geometry questions and in this category, Canada (4 provinces). 
Slovenia, and England (low participation) performed better compared with 
their performance across all mathematics questions and Emilia-Romagna 
(low participation) and Israel (Hebrew) performed less well in relation to 
their performance in general. Performance of populations varied from the 
norm the most in the area of Data Analysis. Statistics, and Probability — 
about 15 percent of the assessment. While the questions in this topic were 
relatively easy, these skills are not always taught to students at this age 
level, which may explain why students in some imputations scored high on 
thesi* items and others scored low. Four population* performed better in 
this category compared with their scores overall — Canada (4 provinces), 
the United States. Scotland (low participation), and England (low 
participation) — and four performed relatively less well than they did 
overall — Hungary. Soviet Union (Russian-speaking schools), Israel 
'Hebrew), and Slovenia. In Algebra and Functions — 10 percent of the 
assessment — 9-year-olds from Hungary. Israel (Hebrew), and Slovenia 
had comparatively higher scores than their overall level of achievement, 
while Emilia-Romagna (low participation) achieved at relatively lower 
levels in this area than it did overall. 



«) For these analyse* of arhievement by top**, population* are riled a* deviating from tfe»ir normal 
pattern if thr diflerrnre between their deviation from the mean for the tapir nod their deviation 
from the overall mean it twice the standard error of thr difference between these deviations or 
greater. Farther details of three analyses are provided in the Procedural Appendix, p. 143. ami 
thr IAEP Technical Report. 
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In addition to the five topics* results are presented for three 
categories of mathematics processes: Conceptual Understanding,, 
Procedural Knowledge, and Problem Solving. The performance of 
comprehensive populations and populations with exclusions or low 
participation in each process area, shown in FIGURE 6.5. in almost ail 
cases follows the same pattern as their overall |>erfnrmance in 
mathematics. The only exception is Taiwan, where students scored letter 
in Procedural Knowledge questions and Iras welt on Problem Solving 
questions compared with their overall achievement levels. 
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The performance of the Canadian populations in the various topic 
and process categories shown in FIGURE 6.6 al»o wan fairly consistent. 
The moat exceptions occur in the topic of Data Analysis. Statistics, and 
Probability, where all Canadian populations performed relatively better 
than they did overall. In addition* 9-year-olds from Ontario (French) 
(terformed less well in Numbers and Operations, better in Geometry, and 
less well on Procedural Knowledge compared with their overall 
achievement. Their peers in Quebec (French) scored relatively higher in 
Geometry than they did overall. Students from British Columbia and New 
Brunswick (English) performed less well in Algebra and Functions 
compared to their overall scores. 
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commits aid ACiilfiailT Collecting background information from 9-year-<»lds 
is a challenge. Children at this age often do not understand difficult 
questions and cannot make fine distinctions in their responses. For these 
reasons the IAEP assessment asked only a few questions about their home 
and school experiences. Also, because the educational environment varies 
from country to country, students may interpret questions in different ways. 

Many of the answers of 9-year-olds mirror the responses of their 
13-year-old schoolmates. Information obtained about the language spoken 
in the home, family size, and number of books in the home is essentially the 
same at both ages. The differences that do occur may be due to misunder- 
standings by some of the younger students. 

Asked about classroom activities. 9-year-olds* responses suggested 
that these students, like their older colleagues, spend more time working 
exercises on their own than doing hands-on activities. As shown in 
FIGURE 6.7. in almost all populations, about 40 to 70 percent of the 
students indicated that they often did independent work, while only 10 to 
30 percent reported that they often used mathematics tools, such as 
counting blocks, geometric shapes, or geometric solids. Fewer Korean and 
Portuguese students reported doing independent work often (23 and 32 
percent, respectively). 

Participating countries differed with respect to organisational 
practices in the classroom. Some were much more likely than others to 
group stuilents by ability within mathematics classes. Most of the schools in 
Scotland (low participation). 78 percent, reported that they use ability 
groups in mathematics, and between 40 and 60 percent of the schools in 
Korea* Hungary, the Soviet Union { Russian-speaking schools). Ireland. 
Canada (4 provinces). Slovenia. England (low participation), and Portugal 
(restricted grades) also said they follow this organizational practice. The 
large majority of schools in the remaining countries use heterogenous 
grouping in mathematics classes. 

The responses to IAEP student questionnaires indicate that the out- 
of -school activities of 9-year-olds differ somewhat from those of their older 
schoolmates. Nine-year-olds were more likely to read books for fun. to 
watch more television, and to spend less time doing homework than 13-year* 
olds. A major portion of young students, about 40 to 60 percent, indicated that 
they read for fun almost every day in all countries except Korea and Taiwan, 
where only about one quarter reported daily leisure reading. 
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Mathematics, Age 9 

Ave rape Percents Correct and Classroom ami Home Activities* 
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The norm for time spent on all homework by 9-year-olds in most all 
populations was one hour or less for all school subjects on a typical school 
day. Heavy concentration on homework at age 9 was very rare in Scotland 
(low participation) and England (low participation*, with fewer than 10 
l>erernt reporting two hours or more nightly. About a third of the students 
in Taiwan, the Soviet Union (Russian-speaking schools), and Israel 
(Hebrew > spent at least two hours on homework a night at age 9. 

About one-half of the students in almost all participating c ountries 
typically rc|N>rted watching two to four hours of television each day. Heavy 
television viewing, five hours or more daily, was more prevalent at age 9 
than among older students. Heavy television viewing was most prevalent in 
Israel (Hebrew). Ireland. Canada, the United States. Scotland 
(low participation), and England (low participation), where about one 
quarter of the 9-year-olds watched television five hours or more each day. 

The relationships between mathematics performance and classroom 
and home factors at age 9. shown in FIGURE 6.8. confirm many «f the 
findings at age 13. However, as at age 13. the results are not always 
consistent across all populations and some counter examples are also 
evident. In Figure 6.8. the pluses, minuses, and sseros indicate whether the 
relationship between achievement and increasing levels of a particular 
background variable for each population is positive, negative, or not 
related in a linear fashion to a statistically significant degree. 

The descriptive data indicate that 9-year-olds tended to sjwnd more 
time doing mathematics exe.-eises on their own and less time working with 
counting blocks, geometric shapes, and geometric solids, and for the 
majority of 1AEP populations, mathematics performance is positively 
related to doing independent work and negatively related to using 
mathematics tools. Since little time is typically spent in using mathematics 
tools, it is too early to tell if hands-tin instructional activities can Im* used 
successfully to build mathematics skills. 

4 

The relationships between out~of-sehool activities ami achievement 
are not as consistent at age 9 an at age 13. Nine-year-olds spent more time 
than their older schoolmate* reading for fun and those who read more 
often performed better on the mathematics assessment. This* was true in 12 
populations. However, the amount of time 9-year-old* spend doing 
homework across all school subjects appears to he unrelated to 
mathematics performance in more than half of the participating countries 
at age 9* |>crhaps because homework is not prevalent at that age* Spending 
more time watching television is also unrelated to achievement for eight 
populations, negatively related to achievement in five, and positively 
related to achievement in one. 
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Mathematics, Age 9 

Relationship of Classroom and Home Factors and 
Average Pereents Correct within Populations 
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coat fttiseni of t- 1* - viAl - »itf ' Miroiatici Collecting data at 

two ages allows populations to compare levels of performance of equivalent 
sample* on equivalent assessment tasks. In mathematics, a set of 14 
questions covering a range of mathematical topics and processes were 
administered to both age groups* 

The average pereents correct across the common items are presented 
for each age group in each participating population in FIGURE 6.9. The 
differences in scores at the two age levels is typically 20 to 30 percentage 
jM>ints. The smallest differences are seen for students from the higher- 
(tcrforming populations of Korea and Emili Romagna (low participation) 

each with a 22-point spread — and the largest, for students from the 

Iowcr-|H»rforming population of Slovenia with a 32-point spread. This 
prohahly reflects the fact that there is mo/e room for growth among lower- 
achieving groups. 

The sample questions shown in FIGURE 6. 10 give three examples of 
tasks that most 13-year-olds can do and most 9-year-olds cannot. 31 It is not 
surprising that vounger students do not understand the correspondence 
between common and decimal fractions required to answer the first sample 
problem. The second example demonstrates a routine numbers problem, 
but it requires the student to work with numl>ers provided in a graphic 
form. Apparently, this application of basic skills makes the task difficult 
for 9-year-olds. The last sample problem require** the students to formulate 
and solve a simple algebraic expression. This is a higher level problem- 
solving task that may be familiar to 13-year-olds but would l>e an unusual 
task for their younger schoolmates. 
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Mathematics, Ages 9 and 13 
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Mathematics. Aja*s 9 and 13: 

Sample Ti*>-t (Juration* 



Which of the following dersmab hi equal to JL ? 

10 



A 0.1 
B 0.3 
©0.9 
D 9.0 



ftp ft 41% 



t 

3 



The figure above show* three different route* 
between two places, measured in mile**. 
How long is the shortest of these routes? 

Answer: f f miles 



Aa« \h 75% 

The total weight of three suitcases is 28 pounds. 
Thr weight of Tern's suitcase is as much as the 
weight of the other two suitcases together. 
What is the weight, in pounds, of Tern's suttrase? 

A 13 
® 14 
C 15 
D 22 
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lATlHfi fit fOUI»ATIONS LIAIIII8 During the primary school year*. 

students arc taught whole-number operation* and are introduced to the 
basic ronivpta of measurement, geometry, charts ami graphs, and 
functional relationships. While the range of mathematics performance* 
amon^ participating countries is not a* great as it in at age 13. some 
population* clearly out-performed others. 

In the classroom. 9-year-olds tended to spend more time doing 
mathematics exercise* on their own than they spent working with 
mathematics tools and the amount of time spent on independent work is 
(positively associated with mathematics achievement. At home, these 
children tended to spend more time reading for fun and watching television 
and less time doing homework across all school subjects than their 13-year- 
old counterparts. 
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A Final Word 



The task of reporting the achievement results in mathematics from 20 
countries as diverse as China, the Soviet Union, the United States, 
Switzerland. Israel. Brazil, and Mozambique is a challenge and a unique 
opportunity* Because it only makes sense to interpret academic 
performance of such a varied group of populations within the educational 
and cultural context of each participant, achievement data have been 
presented together with descriptive information about curriculums. 
classrooms* home environments, and country characteristics. 

While it would have been satisfying to see clear distinctions between 
the characteristics of high- and low-performing countries, the data rarely 
suggest a universal answer to the question of what factors contribute to 
effective schooling and high performance. While consistent relationships 
between certain background characteristics and achievement were often 
noted for a majority of populations, counter examples were almost always 
present. And perhaps this is one of the important findings of the study: 
factors that impact academic performance interact in complex ways and 
operate differently in different cultures and education systems. 

The second important finding relates to the actual levels of 
achievement that were documented. The IAEP results provide educators* 
policymakers* and parents with a view of what students in 20 countries 
know and can do at ages 9 and 13. Unfortunately, the IAEP data may lead 
Home individuals to focus on the academic horse race, and others will 
decide that all comparisons are unfair. Still, international comparative 
achievement data can provide a picture of educational accomplishment 
that expands the value of national findings. As policymakers attempt to set 
goals and standards for their own young citizens* it can be instructive to 
know what levels of achievement are possible as demonstrated by the 
performance of students in other societies. 
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Tin- thru*t of this report ha* bi*en In put aehievrment results into 
onlext. Results have bren displayed ami disrussed together with 
harkground information about thr etirriruhim. rlawsroom 
practice*, students" home mvironmcnts. and the 
rharartcristirs of the society and education system of earh 
participating rountry. These presentations of results have, in some 
instanrrs. identified factors that art* characteristic of high- or low- 
l>erforming population*. But in many rases, the data have reinforced the 
notion that many of these variable* o|>crate differently from rountry to 
rountry ami t-annot l>e interpreted in the same way in all cultures. 

Then what doe* make a difference in j>erforniance levels from 
rountry to rountry? The answrr must lie in a deeper understanding of thr 
interactions anions thr variables that were studied and in a recognition of 
thr significance of othrr factor* that rannot l>e annexed in a survey project 
such an IAKP. Among these are historical tradition*, rttitural valut a, 
svstems of reward, cxwrtatioiia. and motivation, which are most profitably 
studied using method* of observation and interview and reported in the 
form of verbal descriptions rather than liata table* anil graphs. 



1 AEP attempted to rapture some of these difftcult-to-measure 
qualities in a country questionnaire completed by project dhectors. Most 
of the questions asked for descriptive responses as opposed to multiple- 
choice or numerical answers. The following short summaries of each 
country drew upon those descriptions and deHcrilie some of the factors that 
are difficult to quantify. 

These short descriptions can only highlight some of the unique 
characteristics and current challenges that each country faces and, 
different topics are addressed for each situation. Typical themes include: 
demographic characteristics, cultural values, educational systems, the role 
of testing, and current educational reform movements. 

A separate* follow-up study will conduct a series of ethnographic 
studies of several of these environments in an attempt to describe* rather 
than quantify, the qualities of these societies that motivate parents and 
students to value learning and to seek knowledge. It* results will he 
published in JW.'i. 
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One of the largest countries in the world, with an urea over 8.3 million 
square kilometers and a imputation of !!>() million, it presents same 
problems which an* typical of developed countries ami others which are 
common to underdevehqied regions, in spite of its expanse ami of the 
influence of different ethnic groups ( Euroftcans, African*, and Asians), it 
has managed, throughout its history, to maintain its linguistic unity in spite 
of its cultural diversity. 

Regular education in Brazil consists of p re-school, for children 
under 7. which is not compulsory, elementary school from 7 to 11 years of 
age. and secondary school from 15 to 18 years of age. Access to higher 
education is achieved by means of highly selcrtive examination. 

The complexity of the education system presents problems as in 
almost all Latin American countries. The major national concern in 
elementary school is a cycle of relating grades culminated hy students 
dropping out. Even in the first grade. 52 percent of the students fail to 
complete the requirements. Failure rates are particularly high in grades 4 
through 7. Although elementary school is available to alL it only reaches 87 
{tereent of the 30 million children bet veen the ages of 7 and 14. The great 
majority of children do not manage to finish the eight years of schooling 



required by law. The illiteracy rale, which was 26.0 j>ercent in 1980 
dropped to 18.8 pendent in 1989: the largest pocket* of illiteraey oeeur in 
the northeastern part of Brazil (36.5 percent). 

Another eurrent problem concerns the training of 1.2 million 
teachers for elementary school. Approximately 230.000 teachers, mainly in 
the rural and poorer areas, do not have formal teaeher training . 

There is great concern over investment in the various level* of the 
educ ational wystcrm Constitutionally, the federal government must invest 
18 percent of its national budget in education. While many state anil 
munieipat governments must invest 25 percent each of their budgets, some 
munieipal governments are already investing up to 30 or 40 percent 
liecaosc they ronsiiler education an important national challenge. 

CANADA No, of 13-yeGHt& m asmtry 361,600 

%rf13*ym-ddsmlAff frame 94% 

fe Capita GMP (OS?) $17,389 

SdGMP^oueifea^ii 7.4% 

An enormous land mass occupying well over one-half of the North 
American continent. Canada's population of 2ft„> rnidion includes more 
than 6.5 million whose primary language is French. About 15 percent of 
the total fMipulation are ~!Ncw Canadians.** immigrants who have recently 
arrived from Asia. KurojH*. (Central anil South America, and Africa. This 
significant |>opulution of students who npcak different languages and who 
reflect different cultures represents a major challenge to the educational 
system. 

Kac-h of the 10 provinces has its unique demographies, its own 
distinctive economy, which range from rural agricultural to highly 
develojHMl industrial ami financial centers ami its own traditions. Canada 
refers to itself as a mosaic, an apt description. 

Each province considers cduration to l>e its own responsibility and 
not that of the federal government. Nine of the 10 provinces (except for 
Prince Edward Island, population 130,WM>) participated in IAEPand each 
of the nine provincial ministers of education agreed to having its results 
lieeome part of an all-Canada statistic. 

Descriptions of each province's educational priorities can \h* found 
on pages 1 IK through 123. 
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About 71 perrent of the Chinese population lives in rural areas. Although 
great attention is paid to education, the conditions in many school* are not 
suitable for specific* subject instruction. e*|»ef ially for science education. 

Children start school at 6.5 or 7 years of age anil a few of them have 
preschool education. Mine years of compulsory education ore divided into 
6 years of primary school and 3 years of middle school. Students may enter 
3 years of senior middle sehool (general or v -utional). if they pass a highly 
competitive entrance test. 

Ml students have to take at least one test for each subject at the end 
of each semester. Ck-oups of students from China regularly attend 
international competitions in chemistry, physics, and mathematics 
(the Internationa] Mathematics Olympics) ami perform with distinction. 

The current curricula were designed in 1982. Since the intense 
entrance tests comj>ctition places a heavy bunlen on students, a reform of 
school practice is underway. The goals of the reform are: to retluce or 
eliminate Mime non-basic knowledge from textltooks and to supplement 
basic vocational knowledge in middle school. 
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Kngland. the largest of the four countries that comprise the United 
Kingdom, has a population of 47.5 million. About 92 percent of its people 
live in cities and towns and Kngland is one of the most densely populated 
countries in the world. About 2 million English (people are from ethnic 
minority communities with Asian or African-Caribbean origin*. 

All but a small percentage of schools are maintained by governmental 
authorities. Under the new Education Reform Act of 1988. schools may 
seek permission to remove theu; selves from the control oflorul authority 
anti can In* funded directly by the Department of Education and Science. 
The Education Reform Act of 1V88 also introduced a national curriculum 
which specifies for separate subject areas, "attainment targets" at 10 
different levels and requires testing of all students at ages 7. 1 1. 14. and 16. 
Vocational education is also receiving more prominence. 



The goal of education is to develop fully the potential and abilities of 
all individuals. Overall, c urrent educational policies have nought to raise 
standards at all levels of ability, increase parental choice, make higher 
education more widely accessible and more res]N>nsive to the needs of the 
economy, and. generally, to the needs of a multi-ethnic society. 
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A recent law governing education, enacted in 1989. reaffirms the tradition 
that t* It* mentary schools should give priority uttf ntton to the devflopment 
of the haste skills of reading, writing, and mathematics. These are viewed 
as essential in order to pursue higher levels of arademic arhievement. It is 
anticipated that by the year 2.000. HO |>crcent of the students will reaeh 
their senior year of seeonilary sr hool < 12th prude). 

It is a widely held belief that today** youth are less wf II edue ated 
than their predecessors. In the view of many, the present educational 
system places too much emphasis on studies of the classics with insufficient 
stress on pre-profcssional and scientific preparation. This criticism is 
leveled at both secondary and post-secondary institutions. 

Free, public education is considered to be a right of all children 
regardless of socioeconomic conditions and faithful attendance is a civic 
responsibility. Access to a university education is obtained through micccms 
at the Barealaureat examination after secondary studies. A successful 
stuflent may select from most of the universities except medical ami special 
advanced institutions which have further entrance requirements. 

Today*' teachers, once highly regarded, an* uecorded much less 
prestige, even though their recruitment criteria and training are still very 
rigorous. There are many other career options for competent university 
graduates esj>erially those skilled in mathematics and the sciences. 

School funding is shared by the national government (65 percent), 
the local community (20 |>crrent). industry (5 |>ercent ). and families 
( 10 percent). The curriculum goals are set at the national level but local 
schools and teachers have increasing freedom to plan the sequence and 
methodology of instruction. Families an* increasingly involved in their 
children's eilueation and most families help with homework and course 
selection. 
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An industrialized country of riant* to 10.5 million people (97 percent of 
which are ethnic Hungarian). Hungary has a long and successful history of 
valuing education and schooling. Culture and education have always 
enjoyed high esteem throughout the society. 

Like many other Eastern European countries. Hungary is emerging 
aggressively from Marxist frameworks. Indeed* its efforts to radically 
change education during the 1980s created as much confusion as it did new 
direction. 

Traditionally, Hungary has had a strong* centralized, and controlled 
system. Changes in educational legislation and policy in 1985 and 1989 
have opened the system to new groups of stakeholder**: teachers, unions, 
employers, and parents. There are strong differences of opinion and 
debates are underway, but the movement is clearly toward western ideas. 
Severe budget constraints art* slowing the pace of reform and change. 

The priorities of the emerging system have been set: changing the 
foreign language requirements from Russian to other languages, 
introducing a "new moral basis for learning" that aims at higher education 
standards ami competition, strengthening local control of education, and 
encouraging and supporting religious institutions. 
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Ireland is a small country of 3.5 million people, where agriculture and food 
production are vital components of its economy. Over the past thirty years 
the industrial and technological sectors have grown in imjM>rtance so thi t 
today, more than one-half of the population resides in urban areas. 

About 55 percent of 4 year olds and 99 |*erecnt #»f 5 year olds ere 
enrolled in primary school. Edueat >n is compulsory between the ages of 6 
and 15. At age 18. the student enrollment din* r pases to 40 percent. 

Education is centralized anil all primary -school teachers follow a 
common set of curricuf im guidelines. In 1971 „ there was a move to a child- 
centered curriculum and guidelines were established for all subjects. 
Mathematics occupies an important role in the curriculum, but science is 
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taught as part of Social and Environmental Studies, and does not receive 
as much emphasis* 

For post-primarv schools, the department of education prescribes 
curricula for a broad range of subjects that lead to public examination — 
the Junior Certificate after three years and the Leaving Certificate after 
two additional years. 

The teaching profession is highly regarded in Ireland. Students 
entering teacher-education programs have traditionally been among the 
most able. There are limited opportunities for advancement , however, and 
there is concern at the growing imbalance between males and females in the 
teaching force. 

The goal of the educational system is to provide young people with 
the necessary skills and academic preparation for further personal 
development, for working life, for leisure, and for living in the community. 

No. of 13*yeon& in crafty 91,900 

XrfJ3-y«wftfettEPlrarae 71% 

Per Ccpto GUP (US S) $MS2 

%*f&NP spent oadtxtibn 18.2% 

Israel's short history is a record of rapid and constant change. Its Jewish 
population is increasing rapidly due to the regular arrival of large numbers 
of immigrants. The total population of 4.5 million is about 18 percent 
Arabic. Currently there is a surplus of highly trained people in the society. 

The chief goals of Israel's educational policy are the closing of the 
educational gaps among various segments of the population, promoting 
social integration, raising the general level of achievement to strengthen the 
productive sectors of the economy, and promoting Jewish-Zionist consciousness. 

The differences among schools in socioeconomic status and scholastic 
achievement are relatively high and issues of equity, equality, and 
excellence are currently under discussion. Compensatory extracurricular 
activities are provided to more than 30 percent of the student population 
from disadvantaged backgrounds. 

All children are legally bound to attend school from ages five to 15. 
More than 90 percent of the children aged three and four are enrolled in 
preschool programs. More than 50 percent of the high-school students are 
enrolled in vocational, technological, and comprehensive secondary education. 
Others are enrolled in academic education. At age 18, anyone who passes 
entrance examinations may attend universities. Loans and financial aid are 
available for higher education, especially to those from poor backgrounds. 

Reforms are geared toward decentralisation, free choice for parents, 
am! increased community involvement. 
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Italy ha* only been a country for slightly more than 130 years. It is still 
going through the process of Incoming a single society. Although the 
cultural backgrounds of the various region* are different, the national 
media have had a strong homogenizing effect. 

Economic development is most successful in the northern third of the 
country where Emilia- Romugna is located and is least evident in ih** South. 
About 65 |>erecnt of the population lives and works in cities. Even though a 
host of new values have changed the way {teople think* certain cultural 
traditions are still important, an eviileni^ed by the importance of extended 
families, coofterativc societies, and volunteer charitable organizations. 

School learning continues to W held in high respect since school 
certificates and degrees provide access to good jobs anil careers. The 
school system is centralized at the national level but legislation is being 
considered that will increase the financial and organizational autonomy of 
local sehi n>1s. There is a good network of well-cijuipprd vocational and 
technical schools. 

Elementary school teachers increasingly participate in in-service 
training but this is much less common among secondary school faculty 
memlwrs. The main objective of the fairly strong teachers" associations in 
to protect their autonomy and areas of responsibility, 

The primary school's program is relatively new* established in 19K5. 
ami the middle school curriculum, installed in 1 979. has l»een kept current. 
Secondary schools are being encouraged to conduct research and to use 
innovative instructional practices. The current economic crisis imj>o*es 
severe limitations on what is fMissible. but the concern about future inter- 
national competition is a constant stimulus for educational improvement. 
Public school* are under public pressure to improve the quality of general 
education, to delay student specialization, and to increase counseling services. 
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Jordan is a fast-devebj.ing country of about 3 million, mostly Moslems 
with a small percentage of Christians. About 70 jwreent of the population is 
accommodated in urban areas. 
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Kducation policy is strictlv centralized and uniform for the whole 
country. Since 1964. the aim of the national education system ban lieen U% 
integrate elements of Arabic ami Western thought, technology, am! 
scientific development. It also aims at helping every student grow 
intellectually, socially, physically, and emotionally in order to l>ec«me an 
ideal citizen, capable of self-support and of making a positive contribution 
to society. Focus is centered on the diversification of secondary etlueation 
(academic and vocational) and on in-service teacher training. School 
enrollment at the various edurutionul levels has t»ecome one of the highest 
in the world, 

However, the quantitative expansion has lieen at the exj>ensc of 
quality. The ever-increasing use of technology in all aspects of life has 
prompted a new. 10-year Education Reform Plan ( 1989-1999). The plan 
aim* at producing graduates cipiip|H*d with high-quality general etlueation 
geared towards problem solving, critical thinking, analytical skills, and the 
ability to apply information in creative and productive ways in onler to 
give Jordan the skill- and knowledge-intensive workforce it needs to 
develop its domestic technological capacity and to maintain its competitive 
advantage in the region-wide luhor market. 

Basic education has been extended to 10 years. Graduates can 
continue into higher education after passing the General Secondary 
Kducation examination. 
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Korea is an ini'reasingly industrialized nation of 13 million people with u 
growing economy and a highly centralized government. The population, 
which is homogeneous in both language and ethnic origins, is growing at a 
slower pace than in the 19.10k and is more than 90 percent literate. 

The Kducation Act of 194U stipulates that the purpose of education i* 
to "enable every citizen to pcrfii't his {tersonality. uphold the ideals of 
universal fraternity, develop a capability for self-support in life, anil 
enable him to work for the development of a demiwratic state and for the 
eommon prosperity of all humankind."* 

( Itirrirtilum and instructional reforms in the 1970s decreed that 
lectures and textbook* In* supplemented by multiple-learning materials and 
extensive use of radio and television programs. Diagnostic tests and student 
workbooks guide student activity to mastery. 
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Middle school students study mathematics and science four hours per 
week in each subject the first year, then three to four hours per week 
during the second and third years. There are generally 40 to 55 students in 
a classroom with teachers rather than students rotating rooms. 
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Mozambique's population of 15.5 million is predominantly African. Its 
African |>eople can In* divided into roughly 10 different cultural groups, 
the largest of which, the Makun-lffwo. has l>cen heavily influenced by Arab 
cultural traditions including the Moslem faith. The very small non-African 
group is largely Portuguese. 

Before 1970. most schooling was in the hands of missionaries and the 
curriculum was heavily influenced by Portuguese history and culture. At 
that time, it was estimated that only 2 percent of the indigenous population 
had completed four years of primary education. 

Education is now seen as an important vehicle for social change and 
schooling is linked closely to economic development and political needs. In 
1977. education was second only to defense in the national budget. 

Elementary school lasth four years and there are three types of 
secondary schools: lyeeum. technical, and agricultural/vocational. The 
schools" curricula include a substantial amount of health education. 
Agricultural training is conducted both in schools and on farming sites 
since learning to grow crops is a national priority. 

A shortage of trained teachers has presented Mozambique with a 
formidable challenge. To fill the need, the government established regional 
training centers in 1975 where graduates of six years of primary schooling 
were given six months of teacher training. Teachers typically instruct two 
different groups of students each day. one in the morning and one in the 
afternoon. 

PORTUGAL to. of 13yttjr-otfs in tmhy 151,400 
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Fifteen percent of the Iberian peninsula in home to Portugal** 10.5 million 
citizens With historical roots in the Roman. Moslem, and Christian 
cultures Portugal ba» recently joined the European Economic Community 
(EEC) and i* becoming an industrialized country, 
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Since 1974. in rrs|>onae to the growing demand for secondary 
education, the ruuntry has made energetic and creative efforts to increase 
the literary level* of its population through an enormous school literary 
program and through the improvement of adult basic education courses. 

Nine years of schooling are compulsory for all children. Secondary 
schools pnivide optional programs that are predominantly vwational or 
academic. After their secondary education* students can either enter the 
work force or go on to universities. 

Assessment of student achievement in haste and secondary education 
is the res|>onsihility of the schools and is accomplished through continuous 
and final assessments. If students do not attain the ne<*es*ary results they 
are required to repeat a grade level. There are no national examinations. 

The ministry of education is responsible for f Pedagogic, administrative, 
financ ; 'jl. and disciplinary control of all primary and secondary schools. 
Since 1987. important measures have lieen instituted to decentralise, and 
as a consequence, the schools* autonomy has been increased. 

Pre-primary and elementary teachers are trained during a three- or 
four-year course that includes practice teaching. Secondary-school 
teachers must hold university degrees in their areas of sfrccialization. 
There are programs in place to complete the training of uncertified teacher*. 

The new educational policy envisions the modernisation of the 
countrv to enable it to meet the challenges of {participation in the EEC. 

SCOTIAHD of )3-ywJH*hh 01 cooatry 62,100 
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Scotland's tradition of support for a strong and broud educational system 
is a proud one. There are 75O.0M) pupils in its primary and se<-ondary 
schools who are required to continue their education until age 16. Ninety 
percent of them are in comprehensive schools. 

Educational policy is the re*|M>nsihility of the Scottish education 
department ami 12 local education authorities. Evaluation of the education 
svstem is the major res|M>nsihility of Her Majesty's lnsjM»ctors of Schools* 
who routinely report on educational institutions. 

School teachers are trained for at least four years at the post- 
serondarv level and are traditionally respected members of society, though 
some feel they are less valued today than in the past. School *ixe ranges 
widely in terms iA numlier of pupils. There are many very small primary 
school* reflecting the sparse population in certain parts of the country. A 
recent development has been the introduction of local school boards* which 
include both parent and teacher representatives. 
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For a imiK time, almost all srhmd* in the country had tint* nimmon 
curriculum ami common tcxthimk* *crc provided tti schools for all 
subjects. Secondary education was characterized by strenuous eurrirultint 
requirements ami was reserved for students of strong academic ability. 
Sinrr 1W8. the standard* for secondary education have hem adjusted so 
that the main goal* an* now to provide all students a strong basic 
education, anil to develop their |n» r*nniilitit»» ami creativity. Also, the years 
ill compulsory education have Iwen reduced from I J to 9 years. 

Instruction in the higher libels of kmmledge anil skills t* provided 
only tor those planning university eareen*. Higher education is ojwn to all 
who ran pa** «liffieu!t entrance examinations, \ehicvement is viewed as the 
result of diligence. j>ersistencc. ami intelligence 

Public opinion is that the Soviet I'liion has too many university 
graduates whose training is not considernl of high quality. The trend i* to 
improve the quality of graduates ami to reduce their numbers. 

do. of 1 3-f»M^s m country 573,900 

% of 1 3-year eWs in IA£P from 80% 
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Spain"* -W.."> million people are unevenly distributed throughout the 
eoiintr\. During the pa*t decade, its demographic* have changed 
stgnificaittiv as a declining birth rati* has resulted in an increasing 
percentage of retired workers within the society. The workforce has moved 
from agricultural. to imhistriaL anil currently i- looting to the mtvicc 
sector* t»f the economy. * hie of the country *evere*| problems is a high 
unenip|o\uicnt rate, especially among the young. This has resulted in 
higher explanations for better eiltieatetl ami better trained graduates from 
educational institutions. 

The most striking feature of the educational -eeite in Spain Unlay i* 
the deliberate transfer of responsibility for education to the autonomous 
communities. \ vital issue is the liberation of educational institutions from 
excessive rules anil regulations ami the encouragement of local community 
support and involvement. In I 1 ) 4 !!) tin* new federal ediseaiion Ian 
established the sharing of authority and funding of public education by the 
federal government and the autonomous communities. Jt* pro\ initios take 
effect in IW2. 

The national administration define* the content of the curriculum for 
all Spanish schools. However, then* are no national examinations: schools 
evaluate achievement in their unit way. Those who wish to teach at any 
level in the public or private school systems must have a university degree 
and appropriate pedagogical training. 



A major curriculum and aHHmmf nt development program if* 
underwav for ages 5 through 14 following the sui*ecssful introduction of 
new certificate examinations for al! pupils at apt* 1ft. The emphasis in these 
examination* anil in other assessment* is on valid measurement of all 
relevant knowledge anil skills by means of written tests, as well as practical 
anil projeet work. 
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Located at the juncture of three major Kumjieaii cultures. Germanic. 
Romance, anil Slavic Slovenia"* educational system for centuries followed 
Germanic trailitions. This pattern abruptly changed during the 19th 
century- occupation hy NajNdeon's forces ami again in 1918 when Slovenia 
merged with other nations to become Jugoslavia. The first transformation 
was characterized by Romance influences and the second introduced a 
Byzantine flavor. 

The end of World War II brought with it a Soviet influence in all 
areas of Slovenians life, including education. During that time, a numlwr of 
scholars devoted a greut deal of energy to liberalizing those stringent 
cdue utionul concepts and practices. 

Kducation is a strong value among Slovenians homogeneous and 
largely Roman Catholic population, and schooling is mandatory until age 
13. The objectives of elementary and *ccondarv etlucatioii include basic 
and higher-level skills as well as moral values and employment 
preparation. 

Teachers at all levels of education are required to have university 
degrees and at the secondary level are socialists in their subjects. 
Teachers are now able to select their own teaching materials and textbooks 
from local and international sources. Currently there is no national testing 
or assessment program. 
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Until Septemlwr IWL tlie Soviet I nioo was comprised of li> republics, with a 
population of 290 million people of many different cultures and languages. 
New structures and relationships unfolded as the year drew to a close. 
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Kduration is highly valued in the culture and many families privately 
fund a variety of educational enriehment aetivitieK for their children. 



swiTliHtAN* Kaof )3-^ff-okbinGN0^y 73,000 
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A small i-msntry of 7 million in the heart of Europe. Switzerland is made up 
of 26 democratic and independent cantons. Sixty-five percent of it* 
imputation s|>cak (German. 18 |iereent »peak French. 10 |>ercent speak 
Italian, and less than 1 percent. Romanseh. The remaining |>eople speak 
other languages. The economy is moving from an industrial- to a service- 
centered base. Not currently part of the Kuropean Economic Community 
i KEC). the country is wrestling with decisions about its own future. 
Because of its jmlitical structure, a national decision must reflect the 
combined wishes of the 26 cantons. 

Each canton makes its own decisions concerning educational policy, 
teacher certification, curriculum* instructional materials, and standards. 
Regional ministries of cduration are tiny and act by convening groups of 
teachers and administrators and reaching consensus on issues affecting 
schooling. Schools tend to be small and local and are often administered by 
a senior teacher rather than by a full-time director. 

There is growing eon<*crn over the level of preparation being 
provided their young citizens (only 1 1 percent go on to universities} as they 
face direct competition from their peers in neighboring countries. 
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Taiwan is a mountainous. prosf>crous. anil industrialized nation of 20 million 
fteople. 85 |>crcent of whom are Taiwanese and 14 | percent mainland Chinese, 

Education is highly valued and centralteed. All schools use the same 
net of textbooks. While basic facilities such as lal»oratories. computers, and 
instructional materials are readily available, educational exjwrts in Taiwan 
feel they are not properly used in most schools. Teachers are highly 
regarded and there is no shortage of mathematics and science teachers. 

Vfter-school academic-enrichment programs are popular for 
secondary school students. Most parents provide strong home support for 
school programs and regularly pay for extra educational materials. 



An important (-durational goal is to develop a sense of dignity in 
student* bv building their confidence in subjects in which they have shown 
potential. About one quarter of the students leave school for employment 
at about age 15. The others who [man competitive national entrance 
examinations go on for technical etlucation or university training. 
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In the United States, public etlucation extends through grade 12 and about 
three in four students graduate from high school at the cx|>ccted time: 
about 90 |N*recnt earn their secondary diplomas by their early 20s. Half of 
hi^ii-schtMil graduates enter college, anil about one in four will eventually 
enter the full-time labor force with a four-year college degree. 

At present, the nation is engaged in a concerted effort to raise 
educational achievement in a system that is highly de^ntralizcd. 
Kducational authority for elementary and secondary education exists at 
the state level and is decentralized considerably beyund that level to about 
15.000 local school districts. 

The nation's 50 governors and the president have recently 
established six goals for education to lie reached by the year 2000. One 
such uoal is to be Vum/wr / in the world in mathematics and s- :ence by 
that year. 

The l j nited States has Iwcii involveil in an educational reform effort 
for more than a decade. This effort, stimulated by the re|>ort of a national 
Kducational Excellence (lommission. is being carried out by governors and 
legislators: mathematics particularly has Iwen a target lor improvement. 
However, the National Assessment of Educational Progress (NAEP). 
through regular assessments for more than 20 * cars, has found no sus- 
tained improvement in mathematics and science for that period, ulthough 
there has l>een a recovery from declines ir roficieney during the 1970s. 

There are currently under discussion significant changes toward a 
more centralized system including voluntary national curricula, a national 
test, and achievement standards. Adoption of these feature* would 
constitute a major shift in the United States* educational policy. 

These radical departures from traditional practice are lieing 
considered anil promoted because of concerns alwnit the country's ability 
to com|»ete sui-ecssfully in an increasingly technological global market place. 
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AlBEBT A Alberta i* a resource- rich provinee with a multicultural population of 
approximately 2.1 million. About 80 |H*rrent «d* ihe |>eople live in urban 
centers. 

\ll children in Alberta art* entitled to public education ami are 
required to attend school until age 16- The province siip|M»rts two major 
school sysh ms in AUiertu: public ami Catholic. Approximately 20 |»errent 
of all students attend Cathnlie schools. 

The provineial government has primary res|M>n*ibility for education 
and curricula hut shares it with loral school boards. Si nee 19K2. student 
learning has been monitoreii through a provineial assessment program for 
student* in grades li. 6. and V. Provincial examinations, whieh eotint for 50 
|M*reent of a student's final grade in seleeted twelfth-grade courses* have 
l>een in plaee since 1M84. Sehool Iwiards are resjNinsihle for the 
instructional needs .*f their students and for individual student progress. 
The system strives to aehieve equity* excellence, and effectiveness in 
meeting its students* needs. 

Allterta is keen on ensuring that its students an 1 adequately prepared 
to live happily and productively in an international marketplace. Its 
citizens consider international comparisons, such as IAKP. an important 
indicator of how well this goal is being achieved. 

BRITISH COiUMliA Grographirully. British Colombia i> < Canada's third largest 
province and has a {Hipulation of about A million. Greater Vancouver is 
home to ;>0 fierrent of the population with another 20 j>ereent residing in 
the towns and cities of the extreme southwest. 

British Columbia's soeiety is Incoming increasingly diverse. Twenty 
years ago* immigrants were easily integrated into a Ktirt>eentrir education 
system. Today. s|*ceial sehool programs are needed to integrate Asian 
students into the schools. 
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The ministry of education, which is responsible for overall funding 
and direction of the system, plays a leading role both in the development 
and maintenance of curriculum and educational standards. Local hoards 
of trustee* are responsible for distribution of funding, hiring of teachers* 
and delivery of programs and services* 

British Columbia's education system, spurred by the 
recommendations of the latest Royal Commission, is undergoing 
considerable — and very exciting — change. Based upon principles 
concerning the nature of learning, the curriculum and assessment process 
is learner-focused rather than subject matter-focused* Educational change 
is well underway, with significant momentum and support. 

The purpose of the British Columbia school system is to enable 
students to develop their individual potential and to acquire the 
knowledge, skills, and attitudes needed to contribute to a healthy society 
and a prosperous and sustainable economy. 

M ft Ml T 0 1 A Sixty percent of this large province's 1 million fteoplc live in or ne&r 
the capital city of Winning. Brandon* the next largest city, has only 40.000 
inhabitants. 

All students have access to free public education until the age of 21 
and attendance is compulsory until age 16. The goals of elementary 
education are to develop basic skills as well as to introduce students to 
family and societal values, while secondary school* focus on academic and 
vocational preparation anil the development of critical thinking skills. 

r.urriciiliia are designed at the provincial level by committees that 
develop content descriptions and scojh* and sequence patterns across 
grades. I .oral adaptations art* allowed but textbooks and other 
instructional materials are approved at the provincial level. Evaluation is 
the responsibility of local faculties but {teriodie provincial subject matter 
examinations are administered to 12th graders. 

Teachers, who are required to have a university degree, are fairh 
well regarded and paid on a scale similar to other professionals. There is 
some concern that some of the many ethnic groups in the province are not 
represented among Manitoba teachers. Elementary school faculty are more 
child-focused while serondary teachers are tnorc discipline-oriented. 
Family participation in school activities varies according to parents" 
educational and socioeconomic status. Pressure on students to work ban! 
depends upon parental values. 
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N!W •19HSWICI Compared with other Canadian provinces New Brunswick is 
relatively small in terms of its physical sisse {72*515 square kilometers)* It 
has a population of 727*000. *n which almost half resides in urban areas. 

New Brunswick is Canada's only officially bilingual province where 
about 64 percent of the total population classify themselves as English- 
speaking and 32 percent claim French as their first language. The 
remaining 4 percent are bilingual or sjteak different languages at home. 

The provincial government Finam*cs all public srhinds. The 
curriculum is prcsrril>cd and authorized by the ministry of education. The 
province's schools and school hoards are ojmrated on the Iwisis of language. 
There are 27 English-shaking districts and 15 French-speaking districts 
with a combined total of 415 schools. Those now entering the teaching 
profession in New Brunswick must complete a four-year degree program. 

Education is deemed necessary for economic self-reliance and human 
development. Serious efforts are l>eing made to improve and enhance 
public schooling. Just recently, a pmvineially financed, full-day 
kindergarten program was introduced for 5-year-olds. In the near future, 
the release of a provinrially sponsored study dealing with excellence in 
education is cx|»ectcd to initiate dialogue among all the stakeholders in 
public education, 

NEWf OUNOUND Newfoundland includes the island portion and a large territory 
on the mainland of Canada known as l>ahrador. Although the province is 
geographically large, it has a small population of just more than 500.000. 
The total school imputation. Kindergarten through grade 12. is 
approximately 125.000 and is decreasing rapidly because of a low birth 
rate and continuous emigration. 

The language of instruction in almost all schools is English. There is a 
small population of Frcnch-sjteaking natives and immigrants in the 
province, but 98 jiercent of thi>se assessed are English shaking. 

Although Newfoundland's per -pupil expenditure is among the lowest 
in Canada* education is highly valueil and the province commits 1 1.5 
|>errent of its gross national product to it. the highest percentage of the 10 
provinces. 

The province h is a centralized curriculum and the teacher 
j topulution is well educated, A system of provincial examinations sets the 
standard for graduation from secondary school, and ?in assessment 
program to evaluate strengths and weaknesses in the basic skills areas has 
been in place for more than a decade. 



Although the province was not totally satisfied with its performance 
on the IAEP testing, the trends of its own testing programs has shown 
continuous improvement. This gradual improvement gives a real sense of 
optimism about Newfoundland's education system, and it is felt that good 
assessment programs with measures of accountability will further improve 
its education system. 

SCOTIA Nova Scotia is a small province with a total area of 54,400 square 
kilometers and a population of approximately 895.000. Close to half the 
population is of British origin and about 6 percent is French. The rest of 
the population includes sizable groups of Germans, Dutch. Blacks and 
Native j>eople. Forestry, fishing, mining, construction and agriculture 
make up a major part of the economy along with service and tourist 
sectors. 

Nova Scotia has many connections with the traditions and values of 
the British Isles. Education was of particular concern to the settlers, many 
of whom were from educated British families. Shortly after their arrival 
they set up schools to ensure the education of their children. The Acadian 
French also have a significant population and have maintained their 
culture and language. 

AH children in Nova Scotia are entided to a free public school 
education to the age of 21, ami attendance is compulsory from the age of 6 
to 16. The provincial government has overall responsibility for the 
elementary and secondary schools, with 21 local school l>oards handling 
the o|>erations of the schools. Funding is alloc ted on a formula basis with 
both provincial and local input. 

Teacher training is provided at a provincially run teachers" college 
and at universities. All institutions have sujrcrvined prarttcums as part of 
their training programs. 

Academic, vocational, and technical programs are available to meet 
the needs of the population. Promotion and placement are a responsibility 
of local school boards and no central examination system is used. The 
province does, however, have provincially develojicd achievement tents at 
grades 5. 9. and 12 to monitor curriculum throughout the province. These 
assessment instruments are not used for promotion purposes. 

The province is in the process of reviewing curriculum offerings and 
i#f developing n**w guidelines for credit requirements for high school 
completion and issuance of graduation credentials. 



ONTARIO In Ontario, education is the sham! responsibility of the ministry of 

education and the It>eal scht>ol boards. The ministry establishes the goal* of 
education, provides broad curriculum guideline**, approves textbooks, 
establishes requirements for diplomas and certificate* for both teachers 
and students, and distributes operating grants to school boards. It is the 
responsibility of local school hoards to deliver education programs and 
services to their students. 

All permanent residents of Ontario between the ages of 6 and 15 are 
required by law to attend school. Approximately 2 million students are 
enrolled in elementary or secondary schools, lnstruetion in Ontario's 
schools is offered in either English or French. In 1990-9 L close to 98,000 
students received their education with French as the language »f 
instruction. 

The lust decade has seen a significant increase in immigration, and 
about two-thirds of thc*c new children start school with a first language 
other than English or French. To serve the needs of the various cultural 
communities, all newcomers art* given the opportunity to take course* in 
English or French as a second language. Elementary school students are 
given the opportunity to learn about the language and customs of their 
home country through the Heritage languages Program. 

Elementary schools attempt to shaj>c a child's attitude toward 
learning anil provitle the basic skills and motivation for secondary studies. 
Secondary schools (grades 9 to 12) offer a wide variety of courses to 
prepan stutlents for post -secondary education or employment. 

The ministry of education does not administer any province-wide 
examinations. The only school examinations are those given to measure 
students' readiness for selected academic courses and these are reviewed 
by the ministry to improve the consistency of evaluation practices across 
the province. 

0 0 f B E C (Jueliec has a population of almost 7 million people. The largest 
linguistic groups are the Francophones (nearly H5 percent) and the 
Anglophones (more than 12 percent). School attendance is compulsory for 
all youth from age 6 to I ft. Access to the public school system — *ix years of 
elementary education* five years of secondary education — is free for all 
students. 

The ministry of education determines the programs of study and the 
rule* governing the organization of educational services and approves 
textbooks. It also administers compulsory examinations at the end of 
secondary school. 




All elf mentary and secondary teachers must hold a university degree 
and are required to follow the same programs of study, although they have 
a choice of teaching methods and materials. They also have a major part of 
the responsibility for the summative evaluation of their students" learning* 

For the next three years, the ministry \s plan of action identifies the 
following priorities; reduction of the school drop-out rate, consolidation of 
vocational education reforms and of the improvements that have occurred 
in general education, 

SASXATCHIWA* Saskatchewan, officially a province of Canada since 1905. has a 
population of about 1 million. Approximately one-third of the province's 
people live in the two urban centers of Regina and Saskatoon. Forty-four 
percent of the province's students are enrolled in rural areas, Ethnic 
diversity is a feature of Saskatchewan. In addition to the Native people, the 
province's ethnic makeup reflects waves of immigration from various parts 
of the world. 

Enrollment* in kindergarten through grade 12 in puhlicly funded 
schools (public and Catholic) are estimated at 21MMMM) with approximately 
lO.IMM) students enrolled in French language schools ami French 
Immersion programs. The department of education issues official 
curriculum guides and lists of appropriate teaching resources. Alternative 
English and French programs are offered at the secondary level. The 
department of education administers provincial examinations in 18 subject 
areas fi»r grade 12 students. However, only students of non-accredited 
teuehers ,ire obliged to take them. 

The curriculum and instruction review process of the 1980s resulted 
in a new core curriculum. A variety of provincial initiatives in the areas of 
student, program, and curriculum evaluation are also being undertaken. 

1AKP is the first international study in which Saskatchewan has 
participated in recent years. Comparative information from the project 
will be valuable to the province's educational community and to the public 
at large. 
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Procedural Appendix 



IRTItftftUCYIOl The sei-tind International Assessment of ^durational Progress { I A KIM. conducted 



in I WI • i* an international compa rativc study of the mathematics ami science skill* of 
»ampie* of *>- ami IS-ycarniM student* from 20 countries. The firs! I \K1> in IV8H provided 
results on the mathematics anil si^enrc achievement of 13~year-olds from si\ nmntries: 
Can ail a (which conducted separate surveys in four provinces). Ireland. Korea. Spain, the 
I nited kingdom, ami the I nited Static. 12 

The lAKI* applies a technology dcvelo|>ed fur u I nited Staff* project, the National 
Vssessmcnt of ^durational Progress (NAKI*)* which ha* conducted national survey* of the 
educational achievement of United States*" students for more tlian 20 yean*, Ising reliable 
ami uniform M-ientifir procedure*. XAKI* has obtained comprehensive educational 
achievement tiata ami rej noted trrntlnovrr time on student ficrformanre. Since I'JKi. 
Kduratinnai Testing Service tKTS) ha* administered N \KP as well as related promts, 
including I \KP. 

I AKP nan ilesigned to collect ami report ilata on what student* know ami ran do. 
on the educational ami cultural factor* associated with achievement, ami on students' 
attitudes, backgrounds, ami classroom e*|ierirnce*. By utilizing e\ixtin|i N \KV technology 
ami procedures, the time ami money re«|tiired to eomltiet ibi**e international i umparative 
studies reduced ami many interested countries Here able to e*f wriment with these 
innovative jisyrhometrir techniques, 

\fter the first international assessment, interest from representatives of several 
foreign countries prompted KTS staff to develop h pro|>o*al for a second international 
assessment that sought to expand upon the J 9«8 experience. This second project was a 
four-part survey: a main assessment of IS-year-olds" performance in mathematics ami 
•cienre: an assessment of V -year-olds' j performance in maihematio and science; an 
e%perimentai. performance-based assessment of 13-vcar-old** ability to use equipment 
and materials to solve mathematics and science problems: and a short pro-lie of the 
ueograph* skills and knowledge of 1 3- year-olds. All countries participated in the main 
assessment of 1 3-y ear-old*: partiripaiion in the other assessment components wan 
optional. 



•*2 \n hte K. isotonic. >*ncy A. Mead, ami tiary W. Philli|o%. A Wurid of IHjfFrrnre*. in fnferfw- 
tumat tw**menf t*j r Mathematics and Science. Princeton. NJh Kdacational Tr*lin« StrvM^e, I WW. 
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The 1AEP project was asked to provide separate, state-level result* for the mate of 
Colorado, which opted to aw*m its 9- and 1 3- year-old students in mathematics, science, 
and geography. Tbt result* described in thin report, however, include performance 
statist^ only for the United State* as a whole and for participants from the other 19 
countries. The result* from the Colorado state projeet will lie reported in a separate 
publication. 

Each participating rountry was responsible for carrying oat all aspects of the 
project, including sampling, survey administration, quality control, ami data entry using 
standardised procedures that were developed for the project. Several training manuals 
were developed for the I AEP project. These comprehensive documents. discussed with 
participants during several international training sessions, explained in detail each step of 
the assessment process.** 

The senmd International Assessment of Educational Prv>gress is supported 
financially by the National Science Foundation and the U.S. Department of Education's 
National Center for Edueation Statistics for the expenses of overall coordination, 
sampling, data analysis, and reporting. The Carnegie <Iorporation provided additional 
funds to rover the travel e*|>en*e* of some of the participants who could not meet the 
financial burden* of traveling to tin* project's coordination and training meetings. hcM in 
Canada* England. France, Hong Kong, ami the United States. Decisions concerning the 
design and implementation of the project were made collaboratively by the representatives 
of the province* ami countries in vol veil in the survey. The National Acailemy id" Sciences" 
Board on Internatiimal Comparative Studies in Education reviewed plans for I AEP at 
several stages id" its development and made suggestions 1" improve the technical quality of 
the study. The hoard is rcs|»onsthle for reviewing the soundness of the technical 
procedures of international studies fumleti by federal agencies id* the U.S. government. 

PIN 6 Til ISIiSSamT The I AEP assessment wa* devclo|»ed through a consensus- 
building process that involved curriculum ami measurement experts from each of the 
participating countries anil province*. As model*. several existing N AEP framework* were 
reviewed by partici|»ants ami evaluated as to their appropriateness for their own 
countries* curriculums. Together, the )mrtici|»ants then adapted the N.AKP frameworks to 
reflect an international ronsensu* of suhjert-specifie tofrirs and cognitive processes that 
thev Iwdieved reasonably reflected curriculums being implemented in their own school 
systems. ** 

Once the |>artici|>ants hm\ apreed upon common frameworks and the relative 
emphases that would Ik* placed on each to|Mc and r«>gnitive process category #rf the 
assessment, more than one-half submitted test items from their eiHinlries* own assessment 
programs that they felt were appropriate and met the requirements of the IAEP 
assessment. Many questions from the United States* N AEP assessments were inclufled as 
well. These items, more than 1 ,500. were then distributeii to each country and each was 
evaluated and rated for its quality* relevance to the framework, ami appropriateness for 
that rountry *s culture and curricula. The items with the highest ratings across all 
countries were placed into a pool of acceptable questions from which a subset was selected 
and pilot-tested in all of the participating provinces and countries. 3 ^ 

*3 See the IAEP Technical Report for a full di*cu**k>n »f the atandardised assessment procedures. 
3*$ee The 1991 IAEP Assessment: Objcttiv&a for Mathematics. Science, and Geography for a full 

discussion of the development of the frameworks and selection of question*. 
AS One participant. Slovenia, joined the project after the ptto testing had been completed. 
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All question* for the IAEP assessment were screened by subject-matter experts and 
subjected to ETS editorial and sensitivity review procedures to detect any potential bias 
»r lark of sensitivity to any iNirticuIar student group. In non~ English-speaking countries, 
each question was translated into the appropriate language and then checked for oecuraey 
by language e*pert* at ETS. The IAEP assessment included 13 separate language groups 
among the 20 countries. All countries made minor adaptations to the items, such as 
changing mathematical notations {e.g.. decimals point* to commas >. units of measurement 
! yards to meters), and the names of people, places, and types of plants and animals to 
reflect local usage. These adaptations did not alter the psyrhomctric nature or content of 
the assessment questions. 

In the final administration of the assessment, about 70 cognitive test questions or 
items were selected for each subject area and for each age level. Each assessment 
contained a range of questions that measured achievement of the objectives developed by 
the participant*. The mathematics portion of the assessment for both 9- and 13-year^ old* 
contained about one quarter ronstruetrd-rcsfNmsc questions requiring students to 
generate and write their own answers, while the remaining questions required students to 
select from several res|n>nse choices. All of the science and geography items used a 
multiple-choice format. 

KHfl'KK A.I ilescrilies the piercentage distribution* of question* for 9- ami 13- 
> ear-old stutients by tiqiic and ragnitive process. The target f»ercentage* of questions 
within each category were e*taldi*hed at the onset of the project. The final number* ami 
|ierrentages of questions within each Italic ami process category represent final derision* 
after examination of the results of |»tlot- testing in the fwrticif mating countries. After final 
data collection, responses for each question were analyzed to ensure the result* could In* 
summarized accurately for all imputation*. At that time. Mime question* were removed 
From the nummary statistics a* indicated in a later section. 

ItccauM' it is juirtieularly instructive to |M»licymakci> ami educator* to interpret 
achievement result* in context. I AKI' developed three separate background 
questionnaires including i»ne each for the student, the schttol* ami tin* country. The*c 
askml various questions aI»out resounes within the sehiwil and at home, curricular 
emphases, instructional practices* as well a* irther school ami non-school factors that may 
influence learning. In addition, a iimiteti set of »uhjcrt-*|iceifif background question* 
asketi stmlent* f4ir information about the mathematics, science, ami geography instruction 
they received and prol>ed their own attitude* about these subjects. In this report, the 
answers to background question* are examined along with student {performance — for 
example, the relationship between how much television sttntents report watching and their 
performance on the IAEP assessment. Since IAEP was designed to collect only a Iimiteti 
amount of background information from students at one point in time, these analyses 
cannot l»e n*rd to establish * a use-and -effect relationships, which may !** impacted by a 
great number of variables. 

Some of the countries asked other background questions in addition to those 
required by the project in onler to evaluate issue* relevant to their own cultures. These 
additional item* apj>eared at the end of the commonly agircd-upon question*. 
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Pent" Mage Distributions of Questions for 9- and 
Fie on A.l 13- Year-Olds by Mathematics Topic and Cognitive Process** 
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IfSffSMIMT 9ISI6N At each ajzr level, two *cparu!r lNx»klctN. one for rarh subject area in the 
main assessment, were prejta red. At age 13. the mathematics ami srienrv booklets also 
included a small number of geography itcim for <-ountric* that cho*e io assess geography. 
At each age, students writ* administered either a mathematics or a *rtf»rter booklet. The 
administration instruction* ami pn>eedurcs for both the mathematics and seteiwe 
assessments were identical and permitted sampled students at a |>artieular school to Ik* 
assessed together in a single ^Kminute session. 

At age V- each as^sment ImmiMp t was ctmiposed of five pari* railed "hkwkV: four 
15-mimite block* \yf <"ognitivr question* followed by an tmtimed hlork of harkgr* mm i 
question*. For age 13. students were administered four livminute blocks of cognitive 
question*, followed by 7 minuter of background question*. Those countries assessing 
geography also administered a final block that included 7 1/2 minutes of geography items, 
followed by 2 1/2 minute* id* gr«*graphy- related itarkground questions at the end of the 
assessment. 

in each subject area, one common block, "an overlap Mock/* asked 9- ami 
13-year-old students to re*|M>nd ti» the name set of items. This overlap blaek permitted 
IAEP to compare perform* wr at the two age levels. (At age 13. the overlap block 
contained a few additional questions at the end of the block. ) 



The tret question* in earh hiock wrre arranged in ea* y - 1 o- roore-difltr u It ordrr and 
rrflerted a hmad range of nmteot and cognitive pror-esses based on the frameworks 
drwrilwrf earlier. 

In onlrr to minimise the |>ossibir eflTertK td* fatigue on final result*, thr rognttive 
Works were administered in two different seqiirnres. Student* frmn ow-half of the schools 
in earh rountry answered the four cognitive blocks sequentially I Part L Part 2. Part 3. 
Part 4 J followed by the background questions t Part 5). Students in the irther half of the 
*rhool» rr*|>ondcd to the four cognitive blocks in a different order i Part 3. Part 4. Part I, 
Part 21 followed by the background questions f Part 5). t'ountries that opted for the 
geography assessment administered this Idock <Part ft I la Ml in all school*. 

S AM FUNG The sampling design for the IAKP survey raileii for representative sample* of 3*300 
student* from alnwt 1 10 schools ' earh partiri|»ating country at each ape level. Three 
nHintrtc* — lirazii. Korea, and Mozambique — whieb U*gin the *chi>id year in Marrh. 
conducted the survey in Se|Hemlw*r I WO. The remaining 17 countries conducted the 
assessment during an equivalent |wriod in the school year, in March IWI. Srhool samples 
were drawn from puNtr ami jrrivate elementary and secondary schools. Sampler of 9-and 
I3-ycar~oid student* were drawn from those Imrn during calendar years IWI and 1977. 
resjiectivelv. Students assessed in Hrastil ami Korea were si* month* older fhorn lietwccn 
July I . lV7o ami June 30. iM77) because they were assessed si% months earlier. 

The I \KP simple design was a two-Map*. stratified, cluster design. The first-stage 
sampling unit* were usually individual schools, hot in some instances, consisted id* two or 
more small sehmdsM.c.. school cluster**. Typically. I 10 school* or school duster* were 
selected with probability propiM-tionate to the estimated mimiter of age-cligibte students in 
the school. \t the second stage of sampling, a list of ap- eligible students wan prepared for 
earh sampkni schtad. \ *y*irituttir sample of 30 to 3.1 students was typically drawn from 
eaeh school and one-half of the sampled students were assigned the mathematics 
assessment and the remaining half, the *etrm a r assessment. Thus, earh «*uuntrv ty pic ailv 
assessed l.bTri) students in eaeh subject area at earh age level, 

Kai li partieq mting rountry had thr option of selecting its own samples of *<hools 
and student* i>r of having Westat. Ine.. a sampling and »orvey design subcontractor for 
the projeet. %eleet the sample*. Ki%e partiri|»ants. inrluiiin^ Korea. MoxamlM*|Ue. Ontario, 
yoelier. and tin* tniteil States, opteil to have We^tat ^Wl their samples, r.mjntries and 
provinres that eleeteil to seleel their own sampler were trained in the u*e of *|>erialU 
deMpied ri»mputer software en-ateil for thi* pitrfaise. 

M«^t of the partit iftanss nseil the IAKP ilesi|in and M*ftware. S|>eeial ein-umstani'ei* 
in *ome of the |mrtiri|Niting eoontries neressitated the ilrvelopment and use of alternative 
sampling procedures. Their designs. sam|ding proretlures. atol final weights were 
reviewed and approved hy Westat. For example. China and the Sf>virt In ion «f»etl a three- 
Map* .sample {first selecting primary sampling units. I^Sl s. ennMsting of deflned 
geographic arras) lM-eause eentralissetl list* i*f sehotd enrollments f<>r thr entire rountry do 
not exist. In Knglaml ami Switzerland, the nerd to sample whole elassroom* meant that 
alternative witliin-fehoo! sampling pnM*e<lure« using HasHrtMimM as sampling units ha«l to 
Ire dt^igm'd ami implemented, * 



■W»l"he sample designs um*jI by earh partirifiant are ilrw riiwii in oVlail in thr M£f Ttvhfuml Report. 



Some countries drew samples from virtually all children in ike appropriate age 
group and others confined their assessments to specific geographic areas, language 
groups, or grade levels. The definition of populations often coincided with the structure of 
school systems, political divisions, and cultural distinctions. All countries Knitted their 
assessment to students in school, which for some* meant excluding significant numbers of 
age-eligible children. 

In BraeiK two separate samples of 13-year-olds were drawn, one each from the 
cities of Sao Paulo and Fortalexa. In Mozambique* a single sample of 13-year-oMs was 
drawn across two cities, Maputo and Beira. 

In Canada, nine out of 10 provinces drew separate samples of 13-year-olds and five 
of these drew separate samples of English-speaking and French-speaking schools, for a 
total of 14 separate samples. Taken together* these samples represent 94 percent of the 
13-year-okls in Canada. Four Canadian provinces — six separate samples — participated 
in the u ~ year-old assessment, representing 74 percent of the children that age in Canada. 
The assessment of native English-speaking students who were enrolled in French 
immersion programs (where they receive all or most of their instruction in French) was 
not handled in a consistent way across the provinces. In Manitoba and Saskatchewan they 
were a part of the French samples and assessed in French. In Alberta, British Columbia, 
Newfoundland. Nova Scotia, and Quebec they were part of the English samples and 
assessed in English. In Ontario. French-immersion students were part of the English 
sample ami some schools assessed these students in English and others assessed them in 
French. 

The characteristics of the sampling frame of each of the participating countries at 
each age level are documented in FIGURES A. 2 and A. 3. 

The first four columns of Figures A. 2 and A. 3 indicate the representativeness of 
the sampling frames. The first column provides the number of age-eligible children in the 
country. The second and third columns give the estimated percentages of age-eligible 
children included in the sampling frame for the country as a whole and for tin* defined 
population, if the defined population is the whole country, these two percentages are the 
same, if the population is limited to a specific region or language group, the percentage in 
the third column reflects the coverage of the sampling frame within those defined limits. 
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IVrnntajirs in the third rolumn an* sisualH l«*er than 100 i^auhf wimf age 
eligible ehiMreri h«%i- Iwen rxrhiileil from the frame. I tften *tu«fents in *mail M-htmls. 
m h«ml* in remote areas, or in other t*§M»* of M-htioU that fftr Miim« mNm mi*ht !»• itiflk-iih 
toassf-ss hate Jieen evlutleth In Mime ease*, stutlents tn particular grails have Im-wi 
e\ilu<te<l. Umi. sim-e the sample in srhwl-hitseti* ehihlren *>h« *io not attend sehi>ols ha%e 
lwN*it i-xi-hided. ami the mapniluih- «f thi* exclusion is indicated in the fourth column, the 
l»mentaseof ap • liphl^ rhihlri'n attrnrfin^M hiKiJ. If the estimated pereentajee of at^ 
eligible children in the defined |N»pulation included in the sampling frame inJumn 3) is 
Mow W f»ercent. the frame is not considered to Im> representative of the tar-iet-ape 
filiation ami results from these samples an presented as a *j>eetal j*roup of |»>pulalions 
with eiulusiofts ami low }tarttei|»atton. 
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The last three columns of Figure* A.2 and A.3 document the characteristics of the 
sampling frame and the achieved sample* of each participant. The fifth column indicates 
the number of schools in the sampling frame and the sixth column, the estimated number 
of age-eligible student* in those schools used to draw the school sample (i.e., the estimated 
measure of stse). The last column shows the estimated number of age-eligible students 
represented by those who actually look the assessment (i.e., the sum of the student 
sampling weights)* 

Some inconsistencies ran be wen in Figures A.2 and A. 3 because data are drawn 
from different sources, cover different lime frames, and in some cases reflect estimates. 
For example, estimated numbers of age-eligible students are often based on grade data 
rather than age data. On occasion, the estimated number of age-eligible students in the 
school frame or represented by the study is larger than the total number of age-eligible 
children in tin- country. Also, the estimated percentage of age-eKpble children in the 
country included in the sampling frame is nut always derived directly from the total 
number of age-eligible students in the school frame or represented by the study ami the 
total number of age-eligible children in the country. The numbers presented represent the 
best available data for each characteristic of the sampling frames. 

The numbers of schools and students assessed and the school and student 
coogK-ration rates for each participant at each age level are provided in FIGURES A. 4 and 
A.5 that follow. Typically, if more than 5 percent «f the originally sampled schools or 
school clusters refused to mope rate in the survey, alternate school* were selected. The 
total number i>f school* assessed (column 1) includes both originally selected and alternate 
schools that actually {participated in the assessment. The total number of students assessed 
(column 2) includes aU students assessed in mathematics in those schools. 
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Mathematics, Age 9 

Numbers of Schools ami Students Assessed and School and 
Student Cooperation Rates 
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Mathematics, Age 13 

Number* of Schools and Student* Assessed and School 
and Student Cooperation Kates 
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TV school response rales in the third rdumn reflect only the |»errentage of schools 
that were originally sampled and that participated in the asw^nment, The school response 
rate was calculated by using weight* that take into am Hint the number of students that 
would have been sampled if tin* school had participated in the study. Thus* the 
roof*- ration of large schools {in term* «>f exjieetcd number* i>f students) received greater 
weight than the cooperation of smaller schorls. The .student completion rate (column 4) is 
the pen<cntage of sampled students thai were actually assessed in both the original and 
alternate school*. This ratt- was calculated without weights. The combined overall 
response rate (column 5) is the product of the weighted school response rate and student 
complctiun rate* 

Populations with a combined nonresp«»nse rate below .HO but at least .70 have been 
identified in all figures that show performance data with a warning that the results should 
1'.- interpreted with caution because of possible nonrespome bias. Populations with a 
combined nonrcsponse rate Mow .70 have hern identified in all figures that show 
performance data with a warning that results should be interpreted with extreme caution 
I>ecause of fNissibte large nonresponse biases, and for that reason, these populations have 
f»een listed in a s|**cial group of population* with exclusion* or low ]>articipatton. 

Sampling weights have been adjusted to account for school and student 
nonresftonse* St* other adjustments, such as post-stratification, have lieen made. u 

Typically, mist students ape are in their thin! and fourth years of schoolings and 
roost students age 13 arc in their seventh ami eight years. However, tweausc the entry age 
and promotion f >oiicie» differ from country to country, the distrilHJtions of students by 
year in school vary among participant*. While children in most countries begin their first 
year of s hooting at age o. children in Knglaml ami Scotland start at age 5 and children in 
Brazil, parts of China. Mozambique. Slovenia, parts of the Soviet Inion. and German 
Switzerland do not start until age 7. In Ireland, children are required to begin school at 
age b and in the distributions presented in KHil RKS \.h and V7 this is considered to lie 
vear 1 . However, almost all Irish children have had two additional years of infant school, 
which is available to all children and which includes armi^mir work. 



^Details of the compataitoo of school and stooVnt wright are pr«vt#leif in the iAEP Tprhmral Report. 
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Mathematics, Age 9 

I'eree ntage Distributions i>f Sample*! Students 
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Mathematics, Age 13 

IVrrratap* Distributions* of Sample! Stiiiimts 
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0 ft T A COllECTiON Each participating country and Canadian province appointed a National 
Coordi nator to administer dala collection for the IAEP project. These individual* were 
provided with a detailed IAEP \aiu>nal Coordinators Manual and training at on? of two 
regional meetings. While participant* strove to implement all procedures as outlined, 
occasionally they encountered situations where deviations were romuwry. The 
administration procedure* uaed by each particqnitinj: country ami Canadian province are 
Mimmarised in FIGURE 

I^ocal schooi personnel or cxtrrnal administrators i-nndurted the assessment* at the 
selected school*, using standardised procedure* provided in the IAEP School 
Coordinators Manual during the specified assessment period <scc Figure A. 8). The 
administration script read aloud to student* and the time limits for each part of the tent 
were the same in all countries. 

In addition to providing administrators with tin 1 IAEP School Coordinator's 
Manual. IAKP recommended that each country train each administrator in the 
procedures for conducting the assessment. To facilitate the training process. IAEP 
deveioj»cri a training package that included a script for the trainers, suggested overhead 
transparencies, and simulations on how to complete the forms and implement the 
procedures. Based on their own testing programs. paiiiri|»ant» determined which method 
of training would l>c most helpful and efficient. Sinnc of the eountrtes conducted regional 
training session* or used telcph«»ne eimfercnres ami audiotapes to supplement the IAEP 
School Ct»>ntinaiorn Manual (see Figure A. 8). 

Countries were provided with a practice test that students could take a day or two 
prior to the assessment to help them prcparr for the assessment, it was designed 
particular^ for student* who were unfamiliar with multiple-choice formats. Countries 
were not required to use the practice test if they felt it was unnecessary <*ee Figure A.8). 

Q9AUTY CONTROL AMD ON-SITE OBSERVATIONS In order to ensure that the 

assessment* had iieen conducted uniformly in all locations, each country was required to 
develop and follow a quality-control plan approved by ETS. The participants were 
encouraged to conduct unannounced site visits to a random numlfcr of |»arttripating 
schools on the day of the assessment to determine if the standardized priM-edures of the 
assessment were l>eing followed. Observation of 20 |*-rcent on the assessments was 
recommended. Because of limited resources, some countries conduct ed fewer visits 
I see Figure \.8). Some countries felt that making unannounced site visits would 
jeoparduec their relationship with schools and instead implemented informal monitoring 
systems. 

The quality control visits were typically conducted by officials from the ministry. 
re*carch center, or by external staff hired ami trained in IAEP test administration 
procedures. An IAEP Quality Control O&sereer* Manual was <ievcio|#cd as a guide for 
observation visits. The main purp"*** of the visits was to document that the test 
administrator had maintained test security and correctly followed the administration 
M-ttpt, time limits, and rules for answering student questions. 
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Overall Summary of 
Test Administration by 
Country and Canadian Province 
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The project considered quality control of administration crucial to the validity and 
reliability of assessment results, and therefore, a second, independent group of observers 
was hired by ETS to make site visits within each of the countries. These observers, trained 
in the same procedures, in most cases, were fluent in the language of the assessment and 
familiar with the cultural idiosyncrasies of the populations being assessed. They visited 
testing sessions and interviewed project personnel on the management of the assessment in 
all participating countries except Braril ami Mozambique, 



DATA PROCESSUS Once the assessments had been completed, the booklets were returned to a 



central location within each country and cheeked for completeness. The constructed- 
response items for the mathematics assessment were hand-scored, using standardised 
scoring guides. Ten percent of these booklets were scored by a second scorer. The average 
of the percentage of accurate scorn across all questions is given in Figure A .8. 
Afterwards, all responses were either key -entered or scanned into a database. 

Each country was responsible for developing a preliminary data file that followed 
standard formats and contained student responses and other demographic information for 
each population assessed. Requirements for the data files, including 100 percent 
verification of key entry, were specified in the IAEP Data Processing Manual. Specially 
designed software was created for data entry and verification, and data processing 
personnel from each country received training in these procedures at one of five regional 
meetings. All participants were required to use the verification program* which checked 
for duplicate identification numbers and responses that fell outside the expected ranges, 
and to resolve inconsistencies in the data* 

AU database management ami data analysis activities were conducted by a 
Canadian Data Analysis Group consisting of individuals from Educan, Inc., CRICS, the 
Quebec Ministry of Education, and the University of Montreal. 

Completed data files were sent to the IAEP Data Processing Center where files 
were verified a second time and item analyses were conducted to identify other problems 
in the data fifes. In several cases, responses to a specific item from a specific population 
had to be removed from the master data file because of a printing or translation error. 
Each participant also sent 10 samples (selected at random) of each type of test booklet and 
questionnaire so that the data files could be re-checked against the original source 
documents. If the student response portion of the records that were checked contained 
one percent or more errors, participants were required to rekey the entire data file. This 
happened in one instance and the data file was rekeyed. 



IT I* MtCiNTS COIIICT The first stage of analysis involved the calculation of the percentage 



of correct answers and standard errors for individual questions. For each population* the 
weighted percentage of correct answers was calculated for each question. The results of 
students who omitted questions at the ends of sections because they ilid not reach them 
were excluded from the calculations for those questions. For each percent correct, an 
estimate of its standard error was calculated using the jackknife procedure. Percentages 
and standard errors were calculated for subgroups within each population, including 
gender and grade. Statistics for Canada were calculated using an appropriately weighted 
sample of responses drawn from the individual Canadian populations. 




CiOITEl A ■ A I Y S I S To be most useful* survey result* should provide educators, policymakers, 
and the public at large with an easily understood summary of performance in a specific 
content area, while taking into account country-to-eoantry differences in performance 
within sub-areas of the subject being assessed* For example, it is possible that a certain 
topic within a subject might be more difficult for some populations than for others. This 
rountry-by-topic interaction, due to a large extent to differences in canicular emphasis, 
might affect the relative performance standings of the various populations depending 
upon the relative importance assigned to each of the topics in the overall summary 
measure. 

To meet these dual needs, 1AEP conducted a series of analyses before deciding 
which questions could be combined into a summary measure of mathematics. These 
analyses began with a matrix with rows corresponding to the countries ami with columns 
corresponding to the cells in the topic by process matrix (e.g., one cell consisted of 
questions measuring the Numbers and Operations topic and the Conceptual 
Understanding process). The entries in the table were the average percent correct for a 
given country for questions in the topic-by-process cell- These average percent* correct 
were transformed into normal deviates and then converted into country-by-cell 
interactions by removing the overall country and topte-by-process main effects. The 
interaction matrix was then analysed using the interactive K-Meam cluster-analysis 
technique. ** The aim of the analysis was to obtain aggregate sets of questions where the 
count ry-by -ceil type interaction within an aggregate set was negligible . Solutions involving 
one, two, three, and sometimes more dusters were examined in order to define legitimate 
groups of items for summary analyses. These analyses confirmed the reasonableness of 
summarising across all questions in mathematics at each ape level except for one item at 
age 9 and one at age 13 that were identified in the differential item functioning (DIF) 
analyses described below. 

DIFFIBENTIAl ITEM FUHCTIOHIHG White cluster analyses foeus on differences in 

performance across groups of questions defined by topics and processes, differential item 
functioning (DIF) analyses identify differences in performance on a single item. These 
latter analyses are likely to pick up the efferts of cultural and linguistic differences as well 
as rurricular differences. A generalized Mantei-Haenszel statistic was used for these 
analyses/ 11 A test question was identified as functioning differentially across populations if 
students of equal ability but from different populations had different probabilities of 
answering it rorrertly. 

Differential item functioning analyses were conducted for each question for each 
country. For countries assessing in more than one language, items within language groups 
were considered separately. The questions were then ranked in terms of their across- 
population DIF statistics and the magnitude of their ordered DIF statistics was compared 
with reference values that would be expected to be obtained if there were no differential 
item functioning for any question. Questions with across-population DIF statistics that 
were significantly larger than the reference values were identified as outliers. These 
questions wtre deemed to be exhibiting differential item functioning and therefore 
inappropriate for inclusion in summary statistics. 

■^J.A. Harttgan and M.A. Wong. A k- Means Clustering Algorithm. Applied Statistic*, Vol. 28. 
No. 1. 1979. 

S^Grant W. Somes, The Onrralized Mantel- fiaensj*! Statiatir. The American Statistician. 
Vol. 40. No. 2. 1986. 
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The differential item functioning analyses identified one question at age 9 and one 
question at age 13 that wre outliers. These que* t ions were removed from subsequent 
summary analyse**. The question removed at age 9 was categorised an Algebra and 
Function*. Conceptual Understanding. The question removed at age 13 was categorized as 
Numiwrs and Operation*, Procedural Knowledge. 

SOMMIIT ■IASU11S Weighted average |iercentagea of correct rcs|Mmsca were computed for 
each topic and process area and arrows all question* within mathematics fi*r each 
population. They were computed by averaging across the individual weighted percent* 
rurrrrt for the items included in each category. For each average, an estimate of its 
standard error wan calculated using the jarkknife procedure. Average percentages ami 
standard error* were calculateil for subgroup* within each |»opuiation including gender 
and grade. Statistics for Canada were calculateil using an appropriately weighted sample 
of responses drawn from the individual Canadian imputations. 

TUTS 01 SISHIHCIIICI \ lionfcrroni multiple compari*on procedure was uard to determine 
the statistical significance of differences in performance !>ctwecn participating countries. 
This procmlure bold* the proliability of falsely declaring a significant difference to 5 
|iercent arross the entire set i*f |M*s*iblc pairwtse comjiarisons I between the comprehensive 
populations* imputations with exclusions or low jmrtu quition. and Canadian population** 

The procedure used to determine the statistical significance of differences in the 
jwrformance between males and females was to divide the difference I ween the two 
averages by the square root of the sum of the two variant-!**, \alucsof 2 or larger were 
cited as statistically significant. 

The procedure used to determine the statistical significance of differences in 
performance of a pn|tulation on a particular topic or process area ami on the mathematics 
test as a whole looked at the difference between a imputation's ilev ialion from the average 
for the topic or priH'ess ami its deviation from the overall average, \alue* greater than 0 
indicated |N*rformancc in the category was relatively higher than perftH-mance overall and 
values le>s than 0 indicated performance was relatively lower than |w*rformanee overall. If 
the absolute value i>f the difference in those deviations was equal to or greater than twice 
the standard error of that difference, it was cited as statistically significant. 

The linear relationship lieiween levels of a bai kgrotmd variable ami average 
performance was estimated by apply ing a set of orthogonal contrasts to the set of average 
performance by level id the background variable. The linear comjNtnent was estimated by 
the sum of b * where the %j are the average |*ercent correct for students with level j 

on the background variable ami the c^ are defined so that h corresponds to the slope of the 
unweighted regression of the average percent* correct on the levels of the background 
variable. The statistical significance of b was evaluated by comparison with its standard 
•»rr«»r. r«»nt|»uif«l a* th«* Mjuarr root of thf »um ^r^SEy*. whirr SKj i> thr >tainlanl t-rror 
of \j. \alu«*h of l» that wen- equal to or prfatr r than twivr th»- standard i»rn>r v>«Tr 
i-«inMil«*mi to !*• MatiMirally tignififant. 
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TOTAL 






MEP AVERAGE 


58.3 






Papulations 








BRAZIL. FOHTALEZA 


32 4 (06) 


35 2 (09) 


30 5 (06) 


brazil, sao fauio 


370(08) 


37 9(09) 


36 2 (09) 


CANADA 


62 0 (06) 


630(07) 


609(0 6) 


CHINA 


80 2(10) 


81 7 (1 0) 


78.5(1 1) 


ENGLAND 


60 6 (22) 


60.8(30) 


60 4 (22) 




642 (08) 


65 5(0.9) 


62.8 (0.9) 


HUNGARY 


68 4 (08) 


68.5(10) 


683(09) 


IRELAND 


60 5 (09) 


62.6(12) 


58.4(1 1) 


ISRAEL 


63.1 (08) 


64 4 (0.9) 


618(1.1) 


ITALY 


640(09) 


65 8(1 1) 


62.1 (09) 


JORDAN 


404(10) 


414(1.2) 


39 1 (19) 


KOREA 


734(06) 


74 4(09) 


72.2 (1 0) 


MOZAMBIQUE 


28 3 (03) 


28 8(05) 


27.8 (03) 


PORTUOAL 


48 3 (08) 


489(1 3) 


479(09) 


SCOTLAND 


60.6 (09) 


604 (1 0) 


608(1 1) 


SLOVENIA 


571 (08) 


581(08) 


561 (10) 


SOVIET UNION 


702 (1 0) 


700(1 3) 


70 3 (09) 


SHUN 


55 4(08) 


571(1 •> 


53 8 (0.8) 


SWITZERLAND 


70 8(1 3) 


72 8 n 5" 


687(1 1) 


TAIWAN 


72 7(07) 


73 1 (09) 


72 4 (09) 


UNITED STATES 


55 3(1 0) 


558(1 1) 


54 8(1 3) 



Average Percents Correct and Standard Errors 





TOTAL 


MALE 


FEMALE 


CatWditt) PewJrtDn* 








ALBERTA 


64.0(0.7) 


64 5(08) 


634(08) 


BRfTTSH COLUMBIA 


66 2 (0 7) 


668(08) 


65 4(1 0) 


MANfTOBA-ENOUSH 


580(08) 


580(09) 


579(1.0) 


MANITOBA-FRENCH 


631 (06) 


64.5(1 1) 


61.9(08) 


NEW BRUNSWICK-ENGLISH 57 7(05) 


583 (07) 


57.1 (0 7) 


NEW BRUNSWICK-FRENCH 


606(04) 


60.5 (06) 


60.7 (0.6) 


NEWF09NDLAN0 


589(06) 


57 8 (0 7) 


59.9(08) 


ROVA SCOTIA 


59 7 (06) 


60 7 (0.9) 


588(08) 


QNTARJO-ENGUSH 


583(0 8) 


593(10) 


57 4 (09) 


ONTARRVFRENCH 


535(06) 


53 5(08) 


53.5(08) 


QUEBEC-ENGLISH 


65 7 (0 9) 


65 7(1 6) 


65 7(08) 


QUEBEC-FRENCH 


687(0 7) 


69.8(1 0) 


675(08) 


SASKATCHEWAN-ENGLISH 


62 0 (0.7) 


632(09) 


60 7(1 0) 


SASKATCHEWAN-FRENCH 


67 5(1 0) 


68 8(1 5) 


663(14) 



Percentile Scores and Standard Errors 



1ST 5TH 12TH BOTH 

BRAZIL. FORTALEZA 109(0 4) 14 7(06) 173(03) 56 8(2 1) 

BRAZIL. SAO FAUL0 10 3(21) 16 7(10) 187(09) 62.7(0 7) 

CANADA 21 3(08) 32.0(0.0) 37 3(00) 86 7(0 0) 

CHINA 37 0(22) 493(2 7) 57 3(3 3) 980(1 3) 

ENGLAND 18 7(1 9) 27 4 (3 3) 34.5(3 7) 89.3(05) 

FRANCE 22 7(30) 30.7(0.8) 37 3(1 0) 89 3(0 0) 

HUNGARY 21 3(09) 32.4(2.3) 38 7(1 3) 93 3(00) 

IRELAND 17 8(1 3) 28.8(1 7) 333(20) 86 7(0 0) 

ISRAEL 213(1.0) 30.7(10) 37 3(02) 878(2 6) 

ITALY 230(1 3) 324(09) 36 5(15) 880(00) 

JORDAN 133(00) 17 6(1 2) 21.3(1 5) 65.3(31) 

KOREA 200(00) 33.3(15) 413(15) 96.0(00) 

MOZAMBIQUE 11 5(1 1) 162(06) 187(0.1) 448(14) 

PORTUGAL 17 3(09) 23.9(13) 280(05) 74 7(0.9) 

SCOTLAND 213(0 8) 290(2.6) 34 7(00) 86.7(00) 

SLOVENIA 21 3(00) 27.1(3.9) 32.0(01) 82.7(02) 

SOVIET UNION 2C9(24) 352(14) 42 7(08) 92.0(00) 

SPAIN 20.3(1 6) 28 6(0.5) 32 9(20) 7? 4 (08) 

SWITZERLAND 30 7(1 2) 42.7(0.8) 507(19) 93.3(1 3) 

TAIWAN 18 7(1 4) 26.7(00) 350(30) 97 3(1 3) 

UNITED STATES 17 3(3 8) 24 0(0.6) 29 3(0 0) 82 7(1 3) 

Canadian Populations 

ALBERTA 235(26) 33 3(00) 38 7(35) 88 0(0.3) 

BRITISH COLUMBIA 253(07) 356(21) 413(00) 907(4 0) 

MANITOBA-ENGLISH 200(1 7) 28 0(2 7) 33 3(4 2) 827(0 0) 

MANITOBA-FRENCH 26 7(2 7) 34 7(2 4) 41 3(00) 853(00) 

NEW BRUNSWICX-ENGUSH 200(00) 27 5(1.6) 333(00) 827(00) 

MEW BRUNSWICK-FRENCH 20.3(13) 30.2(3.1) 36.0(00) 85.1(1.3) 

NEWFOUNDLAND 187(13) 293(04) 347(00) 84 0 (21) 

NOVA SCOTIA 20.0(0.0) 29 3(12) 351 (15) 85.3(00) 

0NTARTO-EN6USH 200(12) 293(0.0) 347(00) 84 0(20) 

ONTARIO-FRENCH 18 7(02) 253(1 1) 320(00) 760(30) 

QUEBEC-ENGLISH 230(2.5) 33.8(3.9) 413(1.3) 907(00) 

QUEBEC -FRENCH 29.3(14) 39.7(18) 453(28) 89-3(0.0) 

SASKATCHEWAN-ENGLISH 213(13) 297(4 5) 37 3(5.8) 86.7(38) 

SASKATCHEWAN-FRENCH 32.0(13) 360(29) 485(3.7) 87.8(3.9) 



95TH 

653(06) 
70 7 (1 5) 

91 6 (4 3) 
98 7(1 3) 
913(13) 

92 0(5 3) 
960(00) 
907 (00) 
90 1 (00) 
918(05) 
75 7 (33) 
973(1 9) 
500(32) 
80.6(1 7) 
907 (00) 
88 0 (26) 
94 7(00) 
847(1 3) 
94 7 (0 0) 
987(00) 
907(01) 



92.0 11 8) 
94 7(35) 
86 7 (00) 
89.3 (00) 
89.3 (20) 
89.3(00) 
88.0 (58) 
90.7 (00) 
89.3(13) 
827 (00) 
94 7 (24) 
93.3(00) 
907 (00) 
90.7 (2.5) 



99TH 

80 8(35) 
82.7(0 7) 
97 3(1 3) 
100.0 (00) 
97 3(1 0) 

97 3(1 3) 

98 7(00) 
96 0(4 2) 
96 0(3 9) 
96 0(0 0) 
89 3 (52) 
100.0 (00) 
600(2.2) 
89 7 (2.6) 

96 0(00) 
94 7(00) 
98 7(00) 
91.9(2 0) 
98.7(00) 

1000(00) 

97 3(00) 



97 3(00) 
97 3(1 35 
960(3 51 
94.7 (0.0! 
960(00) 
933(00) 
96.0(27) 

97 3(0.0) 
96.0(1.3) 
920(2.3) 

98 7(00) 
96 4 (2.7) 
96.0(00) 
98.0(13) 
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Topic and Process Averages ami Stanoagj Errors 



measure- 

OPEHATttNS MENT 



IAEP TOPIC AVERAGE 

PojHjiatiQni 

BRASU FORTALEZA 
BRAZIL, SAO PAULO 



S1.§ 



BttUO 

IRELAND 
ISRAEL 

rmur 

JORDAN 
IOREA 

MOZAMBIQUE 
PORTUGAL 
SCOTLAND 
SLOVEN*. 
SOVIET UNION 

mm 

SWITZERLAND 
TAIWAN 
UNITED STATES 

Cawflian Populations 
ALBERTA 

BRTTtSN COLUMBIA 

MAJDT08A-EN6USH 

MAWTOSAfRENCH 

NEW BRUB8WTCK-EN6LISH 

NEW WaWSWTCI-fRENCH 

NEWFOUNDLAND 

NOVA SCOTIA 

0NTARJ0-EH8USH 

QNTAROJ-FRENCH 

QUEBEC- EN8US* 

QUEBEC-FRENCH 

SASKATCHEWAN-ENGLISH 

SASKATCHEWAN-FRENCH 



35.8(0.7) 
409(08) 
65.6(0.6) 
84.9(0.9) 
58,5(20) 
65.0(0.7) 
69.4 (07) 
65.1 (0.8) 
64 8(07) 
63.8 (0.8) 
42.8(1.0) 
77.4 (0.6) 
33.8(04) 
52.1 (08) 
59.7(0.8) 
622(0.7) 
695(1.0) 
60.1 (0.6) 
73.6(10) 
74.7(06) 
61.0(1.0) 



68.6(0 7) 
69.3 (0.7) 
625(07) 
67.1(07) 
62 4 (05) 
65.4(0.4) 
619(0.6) 
62.9(0.6) 
61.8(0.8) 
580(06) 
68.7(0.9) 
72.3(06) 
66 1 (06) 
73.9(10) 



46.9 



20.5(0.5) 
24.1 (05) 
49.9(06) 
713(1 5) 
512(2.5) 
52.7(10) 
55.1 (10) 
49.4(10) 
47.2(1.1) 
62.8(1.1) 
32.0(1.0) 
59.5(0.9) 
20 1 (03) 
31.9(0.7) 
51.0(12) 
43.1 (0 9) 
59.7(1.1) 
379(08) 
620(1 5) 
63.7 (09) 
395(1 0) 



54.3(0.9) 
54 .1 (09) 
45.6(09) 
48.5(07) 
51.3(06) 
465(0.5) 
45.1 (07) 
47.3(0.8) 
462 (09) 
388(0.7) 
53.5(1 D 
56.4(10) 
496(0.9) 
538(13) 



GEOMETRY 
622 



28.6(0.8) 
34.3(1 5) 
6Pi(0.7) 
502 (11) 
703(2.4) 
73.1 (0.8) 
73.3(08) 
59.9(11) 
65.8(10) 
75.3(10) 
43.5(1.1} 
774(06) 
292 (05) 
490(13) 
69.6 (09) 
63.1 (10) 
77.6(10) 
60.0(12) 
786(1 3) 
766(08) 
54.3(10) 



672(0.8) 
69 6 (09) 
58.4 (09) 
66.6(08) 
624 (06) 
64 5 (05) 
65.1 (0.9) 
63 7(07) 
63 4(10) 
59.0(10) 
70.6(10) 
78.1 (08) 
629(1 2) 
692 (1 3) 



DATA ANALY- 
SIS. STATS- ALGEBRA 
TICS, AND AND 
PROBABILITY FUNCTIONS 



LI 



438(08) 
49.7(10) 
76.4(0.6) 
754(12) 
79.5(18) 
79.3(0.7) 
75.9(0.8) 
718(1.0) 
74 8(08) 
71.7(0.8) 
45.7(1.0) 
81.2(0.7) 
35.4 (0.6) 
68.6(10) 
79 1 (0.8) 
636(08) 
76.1 (1 3) 
67.7(0.8) 
81.8(1 1) 
812(0.6) 
72.2(10) 



80 0 (0 7) 
799(0 7) 
736(09) 
75.0(08) 
710(0.6) 
72.3(0.5) 
72.4(0 7) 
73.9(0.7) 
73.6(0.8) 
690(0 7) 
78.1 (1.0) 
81.1 (06) 
783(0 7} 
760(1.2) 



842 



32.3(09) 
35.6(1 1) 
52.7 (0.7) 
82.4 (0.9) 
540(28) 

57.0 (1 0) 
69.8(0.9) 
55.6(1 1) 

64.7 (10) 
526(12) 

38.1 (1.3) 

70.8 (0.8) 
205 (0.5) 

43.1 (11) 
52.8(1 2) 
51.8(10) 
719(1.1) 
52.2(12) 
627(1.9) 
69 2 (09) 

49.2 (1.6) 



52 1 (09) 
60 2(08) 
50.8 (1 0) 
58.5(07) 
43.2 (06) 
54 3(04) 
52 7 (06) 
53.5 (08) 
495(10) 
447 (0.9) 
596(1.1) 
58 4 (1 0) 
54.6(08) 
61.6(14) 



CONCEPTUAL 
UNDER- 

STANome 

69.6 



35 3 (0.7) 
38.5(09) 
65.1 (0.6) 
816(1.0) 
62.0(2.1) 

67.4 (0.7) 
69.8(0.7) 

61.5 (0.8) 
63.8(0.8) 
666(0.8) 
44.9(0.9} 
783(0.5) 
34 0(04) 
51.5(09) 
618(09) 
58.5(0.7) 
70.3(10) 
584(0 7} 
71 7(1.1) 
74 7(0 7} 
57 4 (09) 



68.3 (0 7} 
685(07) 
605(0.8) 
646(0.7) 
614 (0.5) 

63 7(0.4) 
618(0.7) 
618(0.6) 
60.8(0 8) 
566(0.7) 
68.3(09) 
726(07) 

64 0(0.7} 
701(12) 



PROCEDURAL PROBLEM 
KNOWLEDGE 1UflN8 



88.4 



30 8 (08) 
36.5(1 1) 
61.9(0.7} 
83.0(0.9) 
590(26) 
65.7(0.9) 
70 8 (08) 
62.0(12) 

65.3 (0.9) 
62.1 (11) 
38.5(12) 

73.4 (0.7) 
22.9(0.4) 
47.1 (1.0) 
592 (10) 
59.0(09) 
732(12) 
55.8(09) 
69.0(14) 
74 7(07) 
560(13) 



62 6 (08) 
68.0(08) 
58.8(09) 
66.0(0.7) 
55.4(0.6) 
62.6(04) 
60.3(07) 
60.2 (0.6) 
58.5(0.9) 
54 .1 (08) 
66.6(1.0) 
68.0(08) 
64 4 (08) 
69.3(10) 



55.9 



310(05) 
38.0(0.6) 
58.9(0.5) 
756(12) 
608(2.0) 
593(08) 
642(0.8) 
57.9(0.8) 
59.8(09) 
632- (0.9) 
37.9(10) 
685(0.7) 
28.2(0.4) 
46.4 (0 7) 
609(0.9) 
53.7(08) 
66.7(1.0) 
519(0.8) 
71.9(1.3) 
686(08) 
52 3(10) 



610(0 7) 
618(0.7} 
54.4(0.7) 
582(06} 
564(05) 
553(0.4) 
54.3(0.6} 
57.1 (0.6) 
55.5(08) 
49.6(0.6) 
61.9(10) 
65.3(08) 
572(07} 
62.9(1 1) 
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Portents Reporting. Average Portents Correct, and Standard Errors 



Amotmti oi WwWf Mattanattet Horowrtrt 









2-3 HTB 


4KRS/H0RE 


BRAZIL FOHTAIE2A 


% 


43(1 .4) 


39(1.2) 


18(14) 


P 


31 (0.6) 


34(0.8) 


40 (i 3) 


brablsAowwu) 


% 


55(17) 


30 (1.2) 


ID (l x) 


P 


37 (1.1) 


38 (10) 


43 (1 .3) 


CAXABA 


% 


58(1 1) 


27 (0.9) 


i£ ff% fit 

1? (OB) 


P 


61 (06) 


64 (08) 


AA iA Aft 

62(09} 


CHHM 


% 


28(1 8) 


35 (1 6) 


17 11 fit 


P 


78(1.3) 


80(1.3) 


ft 4 *l\ fit 

84 (0.9) 


ENBUUD 


% 


65 (3.4) 


30(3,2) 


a tt\ fit 


P 


59(23) 


65 (2 5) 


61 (3-d) 


FRANK 


% 


45(1.5) 


38(1 4) 


17(1 3) 




P 


59(0 9) 


89(1 0) 


69(1 0) 


HUHCARY 


% 


68 (1.3) 


21 (1.2) 


11 (0.7) 




P 


67 (0,9) 


72(1.1) 


TC /4 41 

75(1.4) 


IREIAHO 


% 


48 0.6) 


35(1 4) 


47 #4 *3\ 

17(1.3) 


P 


57(1 1) 


66(12) 


63(1.2) 


ISRAEL 


% 


41 (1.4) 


42(1 3) 


1 7 f 1 4 \ 


P 


61 (0 9) 


64(1 1) 


67(1.1) 


ITALY 


% 


43(1 7) 


30(1.6) 


4 4 il\ 

21 (14) 


P 


65(09) 


62(1.7) 


44 Al 

68(1.2) 


JORUM 


% 


57(1.5) 


29(1.2) 


4/1*1 Al 

14 (l.Uf 


P 


41 (11) 


38(0.9) 


47 #9 rt\ 

47 (2 0) 


KOREA 


% 


29(1.2) 


38(1 1) 


33(1.1? 


P 


71(13) 


74 (0.8) 


75 (0.9) 


MOZAMBIQUE 


% 


63 (1 6) 


27(1 4) 


4 4 «4 K 

11 (12) 


P 


32 (0 5) 


30(07) 


29(1 3) 


PORTUGAL 


% 


72(14) 


19(1.3) 


9(u.e) 


P 


48(08) 


53 (1 4) 


53(1.8) 


SCOTUKO 


% 


75(1 6) 


21 (1 4) 


4 f A fit 

4 (u.O) 


P 


59(0 9) 


65(1 5) 


61 (2.2) 


SLOVENIA 


% 


54(1.5) 


32(14) 


*t *A A\ 
13 (U Sj 


P 


57 (0 7) 


en #4 *i\ 

59 {13} 


C7 il J\ 


sownuwoa 


% 


39 (19) 


28(10) 


33(1.5) 




P 


66(13) 


72(1.2) 


73(1.4) 


SPAM 


% 


52(1.9) 


26(14) 


22(1.3) 


P 


55(10) 


56(10) 


61 (1 1) 


SWITZERLAND 


% 


51(17) 


34(1.3) 


15(12) 




P 


71 (15) 


73(12) 


69(1.6) 


TAIWAN 


% 


47(13) 


29(1.3) 


24(1.2) 


P 


63(09) 


76(10) 


88(08) 


UNITED STATES 


% 


63(21) 


22(15) 


15(1.3) 




P 


52 (0.9) 


60(1.9) 


63(1 6) 



Canadian Populations 
ALBERT* 

BRITISH COLUMBIA 

MANJTOBA-ENflUSH 

MANITOBA-FRENCH 

NEW BRUKSWICX-EN8USH 

NEW BRUNSWICK-FREHCii 

NEWFOUNDLAND 

NOVA SCOTIA 

ONTARIO-ENGLISH 

ONTARIO-FRENCH 

QUEBEC -ENGLISH 

QUEBEC-FRENCH 

SASKATCHEWAN-ENGLISH 

SASKATCHEWAN-FRENCH 



% ^ Percentage irf Students 
P = Average Percent Correct 



% 


58(1.6) 


27(13} 


15(1.2) 


P 


64(06) 


66(1.1) 


63(15) 


% 


59(15) 


30(14) 


12(0.8) 


p 


65(08! 


69(10) 


66(13) 




70|M| 


20(10) 


10(0.8) 


p 


58 (09) 


59(1.1) 


55(1.6) 




52(16) 


31 (16) 


17(15) 


p 


63 (0.8) 


66(10) 


59(1 2) 




67(1.1) 


23(10) 


10(09) 


p 


57(06) 


59(1.0) 


59(13) 


% 


57(13) 


28(10) 


17(0.9) 


p 


60(0.6) 


64 (0.9) 


61 (1.0) 


% 


53(1.4) 


29(10) 


19(1 D 


p 


59(07) 


60(1 0) 


59(1.0) 




59(1.2) 


27 (0.9) 


14 (0.9) 


p 


58(06) 


63 (0.9) 


62(1.2) 


% 


58(1 7) 


27 (1.3) 


16(1.3) 


p 


58(08) 


590 4) 


59(15) 


% 


63(1 7) 


24 (1 4) 


14(1.2) 


p 


54(07) 


56(10) 


55i1.2) 


% 


55(19) 


30(16) 


15(1-1) 


p 


64(12) 


69(1.4) 


67(14) 


% 


57(14) 


28(13) 


14 (08) 


p 


68(0.8) 


71 (0.9) 


68(1 1) 


% 


65(15) 


24(1.3) 


11(10) 


p 


62(08) 


63(1.1) 


59(12) 


% 


52 (34) 


32 (2.8) 


16(26) 


p 


69(15) 


67 (1 5) 


65(2.2) 



m twff fwlllrai 



Pop&btian 




NO KMWK 


1 HRAJESS 






% 


7(07) 


45(1.7) 


48(1.8) 


P 


28(1 1) 


32 (06) 


36 (09) 


BRAZIL. SAO PAULO 


% 


6(10) 


49(1 8) 


45(1.9) 




29 11 3i 


37 (1 2) 


41 (0.8) 


CANADA 




8 fO 6) 




27 (10) 


p 


63(1 3) 


63(0.6) 


59 (0.9) 


CHINA 


% 


3(07) 


52(1 8) 

V4r 1 1 **f 


44(18) 


P 

F 


78 <2 9) 

» W 14., 9/ 


80(12) 


80(1 0) 


EN8UND 


% 


2105) 


64(2 7) 


33(2.8) 


P 




60(21) 


63(28) 


FRANCE 


% 




44(16) 


55(16) 




p 


52 (5.2) 


62(1 1) 


66 (0.7) 


HUNBARY 


% 


0(01) 


42 (1 3) 


58(1.3) 


P 


31 11 9) 


66(1 1) 


70 (0.9) 


tori A Iff) 


% 


1 (05) 


35(1.8) 


63(1.9) 


P 


33(8 31 


57 (1.3) 


64 (09) 


ISRAEL 


% 


1 (02) 


49(1 9) 


50(1.9) 


P 


52(**'i 


65(08) 

W 1 v,v l 


62 (0.9) 


HALT 


% 


0(0 1) 


19(1.2) 


79(1.3) 


P 


43(3 8) 


63(1 7) 


65(0.9) 




% 


3(05) 


40(1.9) 


56(2.0) 


P 


34(2 2) 


40(1 0) 


42(1 3) 


rUjkh 


% 


3(0 5) 


56(1 6) 


41(1 7) 


P 


69(4 0) 


73(0.7) 


75(09) 


MOZAMBIQUE 


% 


2(0 5) 


55(1 8) 


42(1 8) 




P 


31 (2 3i 


32(0 4) 


30(04) 


MtHTIffi41 

rvni uwn • 


% 


5(1 3) 

» i ' j **r 


65(1 7) 


30(1.6) 


P 


44 f2 4) 


51 (1 0) 


47(1.3) 


HUiLMV 


% 


16(1 4\ 


70(1 2) 


14(1 1) 




p 


57 (1 6. 


62 (0.9) 


62(1 7) 


aulVCmfl 


% 


1 (02) 

■ \**'»7 


70(1.6) 


28(1 7) 




P 


57 (8.0) 


59(08) 


53(1 1) 


SOVIET WHO* 


% 


0(02) 


47(16) 


52(1.6) 




P 


55 (6.7) 


69(1.5) 


71(11) 


spas* 


% 


1 (0.4) 


33(15) 


64(1.5) 


P 


47(4 5) 


56(10) 


57(08) 


SWITZBHAMD 


* 


1(02) 


79(1.3) 


20(1.3) 




P 


62(51) 


71 (13) 


71 (1 3) 


TAIWAN 


% 


4(06) 


55(1 1) 


41(13) 




P 


54(2.9) 


68(09) 


81 (1 0) 


BWTEO STATES 


% 


10(1.2) 


61(1 7) 


29(18) 




P 


53(19) 


56(1 3) 


56(1 1) 



Canadian Populations 
ALBERTA 

BRITISH COLUMBIA 
MAMTOBA-ENSLISH 
NANTTOBA-FRENCH 
NEWBRUNSWK3C EN6USH % 



NEWFOUNDLAND 
NOVA SCOTIA 
0NTMH0-EN8LISH 
ONTARIO-FRENCH 
QUEBEC-ENGLISH 
QUEBEC-FRENCH 
SASMTCHEWAN-ENGLSSH 
SASKATCHEWAN- FRENCH 



0/ 

e 


11(1.1) 


68(1 5) 


20(1 3) 


P 


64 (2.1> 


65(0.8) 


62 {1 3) 


% 


8(08) 


66(14) 


25(1 5) 


P 


66(2.1) 


66(0.8, 


^(1 D 


% 


18(1.2) 


63(1 7) 


18(1 4) 


P 


59(1 .7) 


59(08} 


53(14) 


% 


11 (09) 


69(14) 


19(1 3) 


P 


68(2.2) 


64(0 7) 


59(1.4) 


% 


8(0 7) 


75(1 1) 


16(09) 


P 


56(16) 


59(0.5) 


55(1.2) 


% 


9(0 7) 


74(1.3) 


17(11) 


P 


65(14) 


62(0.4) 


55(09) 


% 


6(0.8) 


68(1.5) 


26(1 5) 


P 


59(2.1) 


60(06) 


56(1 1) 


% 


7(08) 


69(12} 


23(1 2) 


P 


60(2.0) 


61 (0.6) 


56(12) 


% 


9(10) 


63(1 4; 


28(16) 


P 


62(1.7) 


60(08) 


54(12) 


% 


9(08) 


68(1 3) 


23(1 3) 


P 


56(17) 


54 (0 6) 


52(1 2) 


% 


5(1 1) 


61 (2.0) 


(19) 


P 


69(1 6) 


66(1 3) 


65(10* 


% 


4(0.6) 


67(1.8) 


29(19) 


P 


71 (2.2) 


69(0.8) 


69(12) 


% 


21 (1 4) 


66(14) 


13(0.9) 


P 


66(12) 


62(08) 


57(15) 


% 


13(2.5) 


72(2.9) 


15(2.1) 


P 


69(3.7) 


68(10) 


63(3 2) 



150 



Mathematics: Age 13 



Fercents Reporting, Average Percepts Correct, and Standard Errors 



Amount* of Dilfy Tetorfcion Vtnriua 



PotNltStlOrtS 




Mm 


£4 MB 


5HKM0K 


pjuTH cnnm pta 


0 

0 


Mi (1 4f 


AQ 1 1 


21 (1.5) 




p 


•J1 iA 71 


JO (U of 


32 (0 9) 




£/ (U 2t 




19 {12) 




D 

r 






39(1.4) 


PAUAfVA 


o 


1ft lA Hi 
10 (U iff 


op(iup 


4 Jt /A T\ 

14(07) 




p 

r 


DO 1 1 v) 


OP (VQ) 


33 (1.0) 


P Mill A 


0, 


EC i4 C\ 




7 <A Ci 

7(0 5) 




P 

r 


fin 1 1 n 

OU t 1 1 ) 


OU \i H) 


77 C\ 

77 (1 5) 


rtjei Aim 


Or 

0 


1 / (4 Of 


do (J 


14(2 2) 




D 

r 


DO |J Uf 


o j U 


C« ill Ci 

51 f2 5) 


EQAiirc 


■,' 
o 


C1 M C\ 




C /A 7i 

5(0 T) 




P 

r 


Aft /1 n\ 

oo n Ut 


o4 y> 


C7 14 71 

57(1 7) 


ftNHtfiMtY 
nvfftlUnT 


8 

0 


ii IU D| 


/0(T Z) 


o /< ni 




Q 

r 


7A m Ok 


OiMU /> 


61 (1 7) 


IRC* ftun 




*>Q f 1 Ci 


OJ (1 4r 


3 (U 9) 




p 

r 




Dl (1 U) 


CA /I &\ 

00(1.0) 




o» 

0 


tlfi 1 1 


03 ft J| 


ZOO 2) 




o 

r 


eft l * n\ 


oo(U o) 


60 (1 3) 


ifm.T 




<t> o p) 


oVf J 4) 


C iA 

5 (0.7) 




r 


Cn ;« TV 


cc tn 7\ 
DO |U 


cfl it% y x 

OS (2.7) 


iOJHVAN 


0 


Wjl el 


Oo 1 1 ^) 


7 1 A fit 

7 (O B) 




p 

r 


10 f 1 fit 


42 (1 3) 


4A H Ot 

40(1 8) 


KflttEA 
MfnCfl 


■ 


OA M It 


O0 (i J) 


4 4 iA A% 

11 (0 o) 




p 

r 


si m n\ 


70 iA 7\ 


03 (1 4) 


Mfl7 A AHttfll fC 


0 


•JX> \1 3? 


44 f t o; 


IA J4 A\ 

20(1 2) 




f5 


H /A e* 


31 (0.4) 


30 (0.6) 




& 


A*} M Cl 


Don D) 


4 4 14 Ai 

11 (1 0) 




P 




oi cQ8) 


t A #4 4 v 

50 (1.4) 




»■ 
D 


1 A 11 A\ 


bo{1 


24 (1 3) 




P 


00 (I 0) 




54 (0 8) 


%t ffME MIA 


ii 


32 0 P> 


C*3 (1 Ci 

OO f I of 


^ IJ.S) 




P 

r 


P© t > Ut 


C7 fft Q\ 


04 (<. 1 1 


SOVIET UNION 


% 


12 f 1 1} 


71(19) 


1700) 




P 


70 H 8} 


71 C1 0) 


67(08) 


SMM 


% 


28(12) 


63H 3> 


10(08) 




P 


581121 


57*09) 


49(13) 


SWrrZERLAND 


% 


41 If 3> 


52 0 3) 


7(0.8) 




P 


72(1 1) 


70(15) 


72(2.3) 


ID WAN 






57 (1 4) 


10(0 7) 




P 


82 CIO) 


70 {09) 


59(18) 


UNITED STATES 


% 


16 It 61 


63(16) 


20 0 7) 




P 


50(22) 


57 (09) 


47 0 8) 







AnHKiftti of Baity Tolmrltiim Vtm^ 


CuatfiM PoptilafKms 




0-1 


MR 


24 HB 


5NRSMBRE 


AlBfUTl 

WLNnln 




20 


(15) 


61(14) 


12(1 0) 




p 


68 


(13) 


64(0 7) 


56(1 4) 


DotTmi cntimMA 


0. 


23 


(15) 


64 (1 5) 


13(1 0) 




D 

r 


69 


03) 


67 (0 7) 


59(15) 


MAJflTnM.Fttni MBtJ 
i^ni i mw * c miupn 


fid. 


15 


(M) 


68(1 2) 


18(1 2) 




p 


60 


(17) 


59 (0 7) 


52(14) 


mwi i muv rnKiVwf! 


£^ 
o 


19 


(16) 


66 0 9) 


15(13) 




P 


67 


(13) 


64 (09) 


57(1 7) 


MFW RRItlKWirtT.ciiCi icu 
vtcn Dfiunp HTvJi'CifoLidfi 


^& 


!3 


(08) 


680.1) 


19(1 1) 




P 

r 


60 


(13) 


59(06) 


52 (09) 


ffCW OflUJIw H ltfJk"T IfElflftfl 


IV 


14 


(10) 


70(1 1) 


16(10) 




O 

r 


61 


(14) 


62 (0.5) 


54(09) 




^0 


11 


(08) 


66(1 2) 


23(10) 




P 

r 


57 


(15) 


61 (06) 


55(10) 


AtfllM CO ATI A 




12 


[09) 


68(1 7) 


21(15) 




P 


61 


0 6) 


62 (08) 


54(1 8) 


¥» I#W1 tVL Ii IfLl^fi 




1 7 


(12) 


*7 (1 4) 


16(12) 




» 


C1 
O I 


(1 7\ 


0iy (0 o) 


£4 #4 At 

51 0 2) 


ONTARIO - FREMCH 




15 


(10) 


68 0 4) 


17(11) 




P 


58 


0 4) 


54 (06) 


50(12) 




% 


22 


(15) 


64(13) 


14(09) 




P 


68 


0 7) 


660 1) 


6005) 


OUEBK-FRCIICH 


% 


18 


0 3) 


71 (14) 


110 0) 




P 


71 


0 2) 


69(07) 


64(17) 


SASKATCMEWAI^ENGIISH 


0 

o 


14 


(10) 


73 (09) 


13(09) 




? 


65 


0 6) 


63(06) 


55(14) 


SASKATCHEWAN- FRENCH 


e o 


22 


[261 


69 (3D 


9 0 8) 




P 


73 


22) 


68 0 2) 


59(4 3) 



% = Percentages ot Students 
P - Average Percent Correct 



Mathematics: Age 13 



Percentages of Students Responding Correctly to 1AEP Assessment [terns 



Tap*: lumbers and Qpefsftoas 

identoty a whole nunH«f grven some ot its properties 
identity wfiat information rs missing 3 problem 
Translate a fraction wifli denominator 10 into decimal form 
Subtract (with regrouping* a deama* from a deamai 
Choose a number ma! mates an inequality true 
Sorve a problem about temperature m wrucfi tfte numbers 

go below zero 
Relate a subtraction tact to an addition fact 
Rnd two digits mat are missing from an addition problem 
identify tfte operation needed to sofve a one- step word problem 
On a map. tmd the length of the shortest route between two ernes 
Supply trie number bemg subtracted in a subtraction problem 
identity a property ot odd and even numbers 
Solve a two-step pro&iem involving age and year ot brrtti 
Solve a word problem mvorvmg simpie ratios 
Translate a fraction into a decimal 
Relate odd and even to consecutive integers 
interpret a whole number that is given as 
trie sum of mufliptes of powers of ten 
Solve a problem by finding a percent of a number 
Choose the mixed n< oer that corresponds to a pom? on a 

mmtter line 

Sofve a problem by usmg division and treating trie remainder 

appropriately 
Mufbpry a decimal by a decimal 
Express a decimal as a percent 
Sofve a tftree-step problem by using several operations on 

whole numbers 
Reinterpret multiplication by a decimal as division 
Pick out ttie smallest deamai from 3 set of five decimate 
Find the smartest common mumpte of two integers 
Sofve a problem repairing division by a mixed number 

Topic. Measurement 

Determine a lengffl on a map using a map scale 

Ptck out possible dimensions of a rectangle of a given area 

Find the length of one srte of a square, given its area 

Relate length of a stick to the number of $tick-lengtrr$ m some 

given length 
Find the volume of a box 

Solve a wont problem involving perimeter of a rectangle 
Sofve a word problem using division and conversion between 

meters and centimeters 
Pick a possible length and width for a rectangre of a given 

distance around 
Sofve a two-step problem involving area and volume 
Compare the areas and perimeters ot two figures 



IMP 
item 
Average 

86 

81 
79 
79 
78 

77 
76 
75 
72 
70 
68 
67 
67 
65 
57 
57 

56 
55 

r >4 

50 
47 
46 

45 
42 
?6 
34 
34 



60 
60 
58 

53 
52 
50 

46 

44 
43 
43 



Topic: Measurement {continued) 



IAEP 
it&m 
Avsrege 



Find the perimeter on an irregular figure 41 
Find area ot a region bounded by straight tines and part of a circle 38 

Find the total surface area ot a cube 33 

Topic: Geometry 

Pick out a possible scare drawing, based on a description 79 

Identity a line of symmetry 75 

Recognize me diameter of a arete 74 

identity a arete from its basic properties 72 

Solve a problem mvotvmg angte measure 66 

Solve a pt&tem mvotvmg perimeter 60 
Relate a two-dimensional pattern to the shape obtained by folding 

the pattern 58 

Fmd how many 0! a shape are needed to cover a larger figure 57 

Solve a problem mvofvmg angle measure 56 

Solve a problem mvofvmg angle measure S3 

Solve a problem involving acute angles 41 

Topic: Data Analysis. Statistics, and Probability 

interpret data from a arete graph 87 

Using ctues about cards, figure out which card was chosen 82 

interpret data from a bar graph 80 

interpret data from a tone graph 72 

Use data from a prctograph 70 

Serve a simple probability problem 65 

interpret data from a line graph 57 

Compute an average 56 

interpret data from a ime graph 53 

Topic Algebra and Functions 

Solve a Imear equation 80 

Solve a word problem using ratios and multiplication 72 

Solve a fcnear equation 67 

Solve a word probtem about positions of people on a line 66 
Evaluate an algebraic expression for certain values ot the variables 66 

Solve a linear equation 61 

Solve a word problem involving a balance scale 56 

Translate from a verbal description into an algebraic equation 54 

Simplify an algebraic expression 48 
Evaluate an argebraic expression for a certain value of the variable 48 
Evaluate an algebraic expression tor a certain value of the variable 48 

Wnte an expression using one variable 45 

Relate a table of vafues to an equation 44 

Solve a two-step number problem 42 

Count the cub® usee to make a tower i shown in a picture) 27 



Mathematics: Age 9 



Mathematics: Ages 9 & 13 



Average Per cents Correct and Standard Errors 



IAEP AVERAGE 
Populations 



TOW 

63.3 



MALE 



FEMALE 



CANADA 


59 9 ;0 5) 


59 9(0.7) 


50 0 (06) 


EK6LAN0 


59.5(1.9) 


58.5(1 5) 


603(2.9) 


HUNGARY 


68 2 (OS) 


682 (081 


c 8 2 (0.8) 


IRELAND 


60 0(08) 


59.9 (Of 


60.1 (1 1) 


ISRAEL 


64.4 (0 7) 


esor j) 


62.7 (09) 


ITALY 


67.8(09) 


695(1 0) 


65 9(1 1) 


KOREA 


74.8(06) 


77 2 (0 7) 


72.4(08) 


PORTUGAL 


55.5(0.9) 


56.8(1 1) 


542(1 1) 


SCOTLAND 


65.7(0.9) 


658(1 1) 


65.6 (1.1) 


SLOVENIA 


55 8(06) 


558 (0 7) 


55.9 (0.7) 


SOVIET UNION 


65.9(13) 


664 (1 2) 


65 4 (1 4) 


SPAIN 


61.9(10) 


619(1 3) 


618(1 D 


TAIWAN 


68.1 (08) 


684(0 8) 


67 8(09) 


UNITED STATES 


58.4(10) 


58.7(1 1) 


58.0(12) 



Canadian Populations 

BRITISH COLUMBIA 61 9(0 7) 618(0.9) 620(09) 

NEW BRUNSWICK-ENGLISH 59 8(05) 60.3(0 7) 59.3 (0.6) 

ONTARIO-ENGLISH 56.8(07) 563(0 9) 57 2(0.9) 

ONTARIO-FRENCH 54 5(06) 54 7(0 7) 54 3(06) 

QUEBEC -ENGLISH 62 5(08) 629(09) 620(10) 

QUEBEC-FRENCH 64.5(0 7) 65.1(08) 64 0(0.8) 



Averages and Standard Errors tor Common Items 





MIC V 


ARE «« 








CJWU0A 


45 1 (05) 


78.1 (05) 


tmum 


43.9(1.9) 


73.7(1.9) 


UttttilDV 


54.1 (08) 


79.8 (0.6) 


IRELAND 


43 6 (0 9) 


74.1 (OS) 


ISRAEL 


52.5 (P 9) 


78.9(0.7) 


ITALY 


54.8 01) 


772(0.9) 


KOREA 


6O.J{07) 


82.2(07) 


PORTUGAL 


41.1 (1-01 


68.3(1.0) 


SCOTLAND 


47.7(09) 


745(08) 


SLOVENIA 


40.6(0.7) 


72.8(07) 


SOVIET UNION 


53.6 (1 5) 


808(0.8) 


SPAM 


49.6(10) 


744(0.7) 


TAIWAN 


506(0.8) 


782 (06) 


UNITED STATES 


456(1 1) 


71.0(11) 


Canadian Populations 






BRITISH COLUMBIA 


480(0 7) 


782(07) 


NEW BRUNSWICK-ENGLISH 


45.5(06) 


708(06) 


ONTARIO-ENGLISH 


42.2(0 7) 


724(08) 


ONTARIO-FRENCH 


39 9(0 7) 


69.5(06) 


QUEBEC-ENGLISH 


48 3109) 


783(0.9) 


QUEBEC -FRENCH 


49.3(0.7) 


83.3(06) 



Mathematics: Age 9 



Percentile Scores and Standard Errors 





1ST 


5TH 


10TH 


BOTH 


B5TH 


99TH 


Populations 














CANADA 


19 6(16) 


28 3(2 5) 


35 7 (1 5) 


836(00) 


885 (00) 


934(2 8) 


ENGLAND 


17 2(2.1) 


26 7(1 6) 


32.8 (0.5) 


86.9 (2 5) 


91 8(33) 


96.7 (00) 


HUNGARY 


20 4 (2.3) 


33 3(1 5) 


40.7 (1 2) 


902 (2.5) 


93 4 (00) 


984 (00) 


IRELAND 


16.0 (3.3) 


24 6(0.4) 


31.2(1 5) 


85 0 (3 9) 


90 2(00) 


95 1 (00) 


ISRAEL 


21.3(04) 


304(2 8) 


38.6(31) 


86 9 12 D 


91 8(00) 


967(00) 


ITALY 


23 0(20) 


34 4(1 6) 


42.6 (03) 


90 2 ( 1 7) 


93 4 (49) 


984(00) 


KOREA 


26.2 (0.9) 


41.0 C" 


50.8 (4 6) 


93.4 (0.0) 


951 (00) 


98.4(00) 


PORTUGAL 


16.7(19) 


262 1- 


316(08) 


81 7 (2 6) 


86 9(001 


93.4(1.6) 


SCOTLAND 


230(01) 


32.8 (0 0) 


39 3 (2 8) 


898(4 6) 


93.3 (2 7) 


96.7(4.6) 


SLOVENIA 


189(0.8) 


27.7(18) 


34 0 (08) 


793(03) 


84 5 (0.0) 


93 1 (00) 


SOVIET UNION 


200 (0.6) 


30.8(1 0) 


37 7 (07) 


90.2 (0.7) 


93.4 (23) 


98.4(0.0) 


SPAIN 


18 8 (0.6) 


268(1 8) 


32 8 (20) 


869(00) 


90.2 (24) 


96 7 (00) 


TAIWAN 


192(1.6) 


32 1 (4 6) 


410(1.8) 


918(1.7) 


95 1 (00) 


98 4 (00) 


UNITED STATES 


180(1 1) 


24.6(00) 


29.5(21) 


836(0.0) 


90.2 (23) 


967(16) 


Canadtan Populations 














BRITISH COLUMBIA 


18 2 (35) 


29.5(00) 


36.1 (3.6) 


85.3 (00) 


90 2 (55) 


96 7 (00) 


NEW BRUNSWICK-ENGLISH 


17 5(13) 


26 7 (2.3) 


339(31) 


83.6 (0.0) 


88.5 (0.2) 


95 1 (00) 


ONTARIO-ENGLISH 


18.0 (0.0) 


24 6(2.41 


312(15) 


81 1 (4 6) 


85 7(31) 


93 4 (00) 


ONTARIO-FRENCH 


180(2.7) 


263(04) 


31 2(0.0) 


77 1 (1 0) 


820(0.0) 


902 (53) 


QUEBEC-ENGLISH 


180 (0.0) 


295 (0.4) 


361 (17) 


869(0.9) 


90.2 (00) 


967(0.0) 


QUEBEC-FRENCH 


23 0(00) 


328(06) 


40.7 (4 5) 


85.3 (00) 


88 5(13) 


95.1 (0.0) 



Mathematics: Age 9 

Topic and Process Averages ami Standard Errors 



IAEP TOPIC AVERAGE 

CANADA 

ENGLAND 

HUNGARY 

IRELAND 

ISRAEL 

ITALY 

K OREA 

PORTUGAL 

SCOTLAND 

SLOVENIA 

SOVIET UNION 

SPAIN 

TAIWAN 

UNITED STATES 

Cana&an Populations 

BRITISH COLUMBIA 

NEW BRUNSVACK-ENGLfiH 

ONTARIO-ENGLISH 

ONTARIO-FRENCH 

QUEBEC-ENGLISH 

QUEBEC-FRENCH 



NUMBERS 

AND MEASURE- 

OPERATIONS MENT 

61J 872 



55 0(06) 65 4(0 5) 

53 6(2.1) 67 2(1 6) 
575(07) 71 6(0 7) 
56.0(09) 64 2(08) 
636(08) 699(0 7) 
67.3(09) 733(09) 
74 6(06) 730(08) 
544(1 1) 58.3(0 7) 
62.1 (10) 71 3(09) 
52.7 (06) 62.4 (05) 
65.7(13) 713(10) 
613(1 1) 608(08) 
671 (0.8) 69 3(08) 

54 3(1 1) 63 2(10) 



58 7(08) 67 4(0 7) 

56.1 (06) 660(05) 

52.0 (08) 63 3 (0 7) 

482(08) 600(0 7) 

585(09) 691(0 7) 

591 (08) 681(0 7) 



SRI, STATIS- 
TIC*, AND 
GEOMETRY PROBABILITY 

53.9 S7.B 



64 7(06) 72.3(0 5) 

670(1 5) 704(1 7) 

686(0 7) 63 4(08) 

579(09) 652(0.8) 

588(0 9) 63.9(10) 

646(1 1) 71 1(09) 

754(0 7) 793(06) 

55.6(12) 57.1(10) 

685(08) 73.9(08) 

631(08) 54 2(08) 

644(13) 601(15) 

601(1 1) 69.3(1 1) 

692(0 8) 72 8(0 8) 

569(1 0) 728(1 1) 



624(1 0) 72 3(08) 

631(0 5) 693(06) 

600(09) 69 5(07) 

61 7(0 7) 67 6(0 7) 

64 1 (0 9) 73 2 (0 7) 

72 8(0 7) 76 8(07) 



ALGEBRA CONCEPTUAL 

AND UNDER- 

FUNCTIONS STANDING 

61.8 63.2 



564(06) 60 4(05) 

56 9(21) 60 7(1 7) 

72 4(08) 68 2(06) 

59,4 (1 0) 59 3 (08) 

668(0.7) 62 6(08) 

60.8(1 3) 67 8(09) 

72.1 (07) 750(0.6) 

54 6(10) 557(09) 

631 (1 2) 66.3(08) 

578(06) 56.3(06) 

678(13) 63.0(1 3) 

583(1 1) 608(10) 

642(08) 68 5(08) 

55.3(10) 59 7(1 0) 



565(07) 62 1 (0 7) 

54 6(05) 612(04) 

52 2(07) 576(0 7) 

551 (06) 55 9(06) 

575(08) 63 5(08) 

636(03) 64 6(06) 



PROCEDURAL PROBLEM 
KNOWLEGE SOLVING 

68.7 58 5 



611(06) 57 4(05) 

592(20) 579(1 9) 

70.8(07) 644(07) 

63.9108) 55.5(09) 

683(08) 61 6(08) 

725(09) 60.6(1 1) 

78 7(06) 688(06) 

595(11) 492(1.0) 

679(10) 61 8(08) 

57 6(06) 52 3(07) 

72.0(12) 617(1.4) 

661 (1 0) 57 3(1 1) 

761 (08) 55 7(0.8) 

595(1 1) 545(10) 



637(08) 591(07) 

61 1(06) 55 7(06) 

576(08) 54 3(07) 

54 4(06) 52.4(0 7) 

639(08) 58 7(08) 

662(09) 620(08) 



Perceots Reporting. Average Percents Correct, and Standard Errors 



Affi&wts of Oatfy Hftmswoifc 




Populations 




0-1 HR 


24 NHS 




Powta&ons 




NOKJKWX 


1 KR1ESS 




CANADA 


% 


72109) 


19(08) 


10(06) I 


CANADA 




29(12) 


580 1) 


13 (06) 


P 


61 {05) 


59 (08) 


61(15) ! 




P 


61 (0 8) 


61 (05) 


530 3) 


ENS1AKO 


% 


84(2 3) 


12(1 9) 


5 (0 9) I 


ENGLAND 


0 


54(4 6) 


37(4 4) 


90 2) 


P 


60(1 7) 


61(4 1) 


55(4 2) 




P 


58(14) 


63(3 8) 


53(3.2) 


HUNGARY 


% 


49(1 8) 


27(14) 


23(16) i 


HUNGARY 


v o 


2(0 5) 


72(14) 


25 0 4) 


p 


67 (09) 


66(1 2) 


74(13) . 




P 


65(4 2) 


69(0 7) 


660 D 


IRELAND 


% 


63(21) 


22(1 5) 


15 (1 6) 


IRELAND 


°0 


2(04) 


800 7} 


180 5) 


P 


59(09) 


64(17) 


61 (1 8) j 




P 


39(3 7) 


62(0 9) 


560 4) 


ISRAEL 


% 


55(14) 


2611 2) 


19(10) \ 


ISRAEL 


a 

c 


4(0 7) 


600 6) 


35 0 5) 


P 


63(0 7) 


62(1 2) 


70(14) ; 




P 


55(2 5) 


65(09) 


64 0 0) 


ITALY 


% 


62(2 2) 


23(18) 


15(16) 


ITALY 


0 

0 


5(09) 


760 7) 


17(1 5) 




P 


67 (OS) 


66(14) 


73(20) ! 




p 


75 f 2 0) 


67 0 0) 


680 8) 


KOREA 


% 


51 (1 6) 


32(1 2) 


17(10) } 


KOREA 


°0 


2(04) 


77 0 1) 


220 D 


p 


75(06) 


74 (09) 


77(1.2) 




p 


68(4 1) 


75(0 6) 


750 1) 


PORTUGAL 


% 


59(16) 


23(1 6) 


18(14) ; 


PORTUGAL 


% 


2(06) 


78(18) 


20 0 7) 




P 


53(10) 


55(14) 


63(21) 




p 


48(5.6) 


570 1) 


51 0 6) 


SCOTLAND 




84(1 4) 


12(1 3) 


4 (0 7) 


SCOTLAND 


Q 


18(28) 


78(3 0) 


4(06) 


p 


66(09) 


68(1 8) 


66 (3 7) 




P 


65 1 2 3) 


67(0 9) 


52(4 7) 


SLOVENIA 




61 (1 7) 


24(1 4) 


16(11) | 


SLOVENIA 


% 


4(0 7) 


81 0 2) 


150 1) 




p 


55(0 7) 


56(1.0) 


59(15) 




P 


53(2 6) 


57(0 6) 


53(1 3) 


SOVIET UNION 




52 ( 2 9) 


23(14) 


25(2 3) 1 


SOVIET UNION 


% 


2(0 3) 


68(1 4) 


31 0 3) 


p 


63(1 3) 


67 (2 0) 


72i ;) 




P 


55 (6 2) 


66(1 4) 


66 0 2) 


SPAIN 




46(20) 


29(1 5) 


25(16) 


SPAIN 




15(16) 


550 9) 


290#) 


p 


59(10) 


61 H2) 


69(15) j 




P 


61 (2.0) 


620 0) 


6*0 2) 


TAIWAN 




5006) 


35(1 2) 


15(13) 


TAIWAN 


\ 


2 (0 5) 


67(13) 


31 0 2) 


p 


68(0 7) 


67(1 1) 


70(1 8) 




? 


45 (5 7) 


70 (0 7) 


67 0 D 


UNITED STATES 




65(1 7) 


20(1 1) 


14(1 1) 


UNITED STATES 


% 


20(1 8) 


59(2 0} 


20(12) 


p 


59(1 U 


56t16) 


58(2 5) 




P 


1*90 4) 


590 1) 


5604) 


Canadian Populations 










Canadian Populations 










BRITISH COLUMBIA 


% 


59(16) 


19(1 4) 


12(1 0) 


BRITISH C0LUM81A 


y. 
0 


32(20) 


54(2 0) 


13(1 0) 




p 


62(08) 


60(1 2) 


64(1 7) 




P 


62(1 1) 


63(0 8) 


560 3) 


NEW BRUNSWICK-ENGLISH 




73(1 2) 


17(1 1) 


10(0 7) 


NEW BRUNSWICK-ENGLISH 


% 


7(06) 


79(09) 


U (0 9) 




p 


61 (06) 


58(11) 


57(16) 




P 


63(1 8) 


61 (0 6) 


500 3) 


DNTAftiO-ENSLSH 


s 


74 (1 5) 


18(1.2) 


7(08 


ONTARIO-ENGLISH 




45 (21) 


42 0 8) 


I3f10) 


p 


58{0.7) 


55(12) 


53(24) 




P 


61 (09) 


56(0.9) 


480.4) 


ONTARIO-ffffiNCH 


% 


70(15) 


19(13) 


11 (08) 


ONTARIO-FRENCH 


% 


15(1 2) 


73 0 6) 


11 (0.9) 




p 


55(06) 


54(13) 


59(18) 




P 


580 3) 


55(06) 


4705) 


QUEBEC-ENOUStt 


% 


86(1.5) 


21(13) 


14(1 1) 


QUEBEC-ENGLISH 


a. 

D 


8(14) 


710 9) 


20 0.2) 




p 


61 (08) 


64(13) 


67(1 3) 




P 


62(18) 


63(08) 


62 0 4) 


QUEBEC-FRENCH 


% 


68(13) 


20 (0.9) 


13(10) 


QUEBEC- FRENCH 


% 


3(05) 


84(10) 


13O.0) 




p 


65*0.7) 


64(1.2) 


68(1 3) 




P 


58(2.9) 


66(0 7) 


62 0 8} 



% * Percenta&ss of Students 
P » Average Percent Correct 



.04 



Mathematics: Age 9 



Percents Reporting, Average Percents Correct, ami Standard Errors 



Arosnt i of OiHy Mftttfoo Wwtot 







Mia 


7-JHRS 


SHRS/M 


CANADA 


% 


28(0.8) 


50(1.0) 


22(0.8) 




P 


60(08) 


63(06) 


54(0.8) 


mum 


% 


26(29) 


51 (25) 


23(2.0) 




P 


60(40) 


62(1.7) 


54(1.5) 


HUNSARY 


% 


27(1.3) 


58(1.3) 


16(1.2) 




P 


67(12) 


70(08) 


61 (14) 


IRELAND 


% 


24(1.5) 


53(1.6) 


23(1.5) 




P 


59(14) 


62(1.0) 


56(1.4) 


ISRAEL 


% 


23(11) 


53(1.4) 


24(1.1) 




P 


58(0.9) 


68(0.9) 


63(1.3) 


ITALY 


% 


46(1.2) 


45(1.1) 


9(0.8) 




P 


67(1.3) 


69(0.7) 


63(2.1) 


KOREA 


% 


26(1.1) 


65(1.2) 


9(07) 




P 


74(10) 


76(0.7) 


69(1.6) 


PORTUGAL 


% 


34(1.6) 


46(17) 


20(15) 




P 


52(17) 


59(1.1) 


54(1.5) 


SCOTLAND 


% 


23(1.9) 


54(20) 


23(1.5) 




P 


62(19) 


68(0.9) 


84(1.7) 


SLOVENIA 


% 


41 (16) 


51 (1.7) 


8(0.6) 




P 


56(0.7) 


57(0.7) 


51 (1.6) 



% tt Percentages at Students 
P s Av$ra<j6 Percent Correct 



S0VKTDW» 
SMUt 
TKWfttt 
UfiTEDSWES 

BRITISH COLUMBIA % 

P 

ISWBRUftSVlCK-fNSLfSH % 

p 

0NTARIO-ER6USH % 

P 

ONTARIO-FRENCH % 

P 

QUEBEC-EJfOUSH % 

P 

QUEBEC-FRENCH % 

P 





0-1 HR 


24 MB 


5HRSMI 




26(1.5) 


56(14) 


18(07) 


P 


64(1.4) 


68(1.5) 


62(13) 


% 


33(1.7) 


50(1.5) 


17(1.4) 


p 


60(1.4) 


64(1.0) 


58(15) 


% 


43(1.5) 


48(1.4) 


8(08) 


p 


68(1.0) 


70(08) 


57(1.8) 


% 


25(1.2) 


49(1.4) 


26(1.6) 


p 


57(1.7) 


62(11) 


54(12) 



28(1.5) 
61(10) 
23(1.1) 
56(1.1) 
24(11) 
55(1.1) 
26(1 C) 
55(1.1) 
30(1.5) 
63(1.3) 
36(1.3) 
64(1.0) 



51 (14) 
63(08) 
51 (14) 
62(0.6) 
49(14) 
60(0.8) 
55(1.3) 
56(0.7) 

51 (1 3) 
64(0.6) 

52 (1.3) 
67(0.8) 



21 (12) 
57(1.1) 
27(1.0) 
59(0.9) 
27(1.3) 
53(1.0) 
19(12) 
52(11) 
19(12) 
59(1.1) 
12(0.9) 
58(1.6) 



Mathematics: Age 9 

Percentages of Students Responding Correctly to tAEP Assessment items 



Topic: ttambere and Operations 

Soto a one-step problem using subtraction 
Multiply a one-digit number by another one-dig tt number 
Soke a one-step problem using division 
Rnd one-half of a iw«gft even number 
Pk* anfrmebc operation appropriate for a smrpie word problem 
Solve a word problem esmg aAffiion and subtraction 
fii^amis^d^^ast^mact^proWem 
identity a whole number grven some of its property 
Choose pictures mat IHtatrate the meaning of a fraction 
Soto a two-step probiero using addition and subtraction 
Soto a word problem using factors 
Subtract, wrth regroupmg, tftree-digii numbers 
Soto a one-step problem using stdftactm 
Soh^ai^proi^usmgmiimplicibon 
Identify tfte information missing bom a probiem 
Count objects tat are grouped in 100$ and 10s 
Pick toe operation to soto a word problem mat has extraneous 
information 

Determine bow a change m one digit affects me sue of a number 

Find a number that satisfies a certain inequality 

Soto a two-step problem usmg muffip&cabon 

Soto a word problem using rabos and addition 

Find Dfw-trtjrd of a two-digit number, (whole number answer) 

Suppry tt» number being subtracted m a subtraction proWem 

Count the odd numbers in a given range of integers 

Relate a aubtractton tact te an addAon fact 

Identity a property of odd and even numbers 

Solve a two-step problem mvofvmg a^e and year o* birth 

Translate a fraction wrth denominator 10 mto decimal form 

Ratals odd and ewn to consecutive integers 

On a map, find the length of me shortest route between two crfces 

Out of four digits, make a number satisfying certain conditions 

Top** ftffaassfrement 

Complete a pattern aworvrng squares 

Figure out how to balance two groups of martoes 



Item 

*wp Topic: Maasaremaai (continued) 



87 
84 

80 
80 

78 
77 
72 
71 
70 



67 
66 
63 
63 
63 

59 
59 
59 
58 
58 
55 
55 
54 
52 
48 
45 
41 
39 
39 
37 

87 
84 



Among figures dMded mto wnt Hocks, pic* toe one wrtfi 

greatest area 

Soto a problem mvofvmg hours and mmutes 

Read a below-zero temperature shown on a thermometer 

Relate volume of ^ot^tebowmanyofto«c^ectw$llflt 
Moabon 

Given die distance around a square, find me length of one side 
Find the distance around a given rectan$e 
Measure a segment when zero-pomt of ruler is not at end of 
segment 

Topic Oeometiy 

KJerrttfy a rectengfe {from a picture) 

Kterttrfy which figures have fine symmetiy 

Vteuatiaarectengutaraold 

Count foe faces of a sctid figure 

htenwy a cire l s fro m ita base properties 

Complete a pattern involving triangles 

Tfepte: Data Aaaffsfe, Statistics, ami Probability 

Read a cucte graph 

Read a bar graph 

Real a bar graph 

interpret data from a bar graph 

Complete a bar graph 

Using dues about cards, figure out which card was chosen 

Interpret data from a circle graph 

Soto a simple probability problem 

Topic Algebra and Functions 

Given a pattern of numbers, fmd the next number 

Complete a number sentence involving subtraction 

Gfven a pattern of numbers, find the missmq number 

Complete a number sentence mvoJvfng addition 

Solve a word problem about pcs/tions of people on a line 

Solve a word problem using ratios and muftiphcafcon 



Canadian Data 



Mathematics: Age 13, Percent of Students Reporting 



MATHS 
FOR BOYS 

Moeeus 



Csatttta Pupstattons 

R uga 

BMTOSH COUM M W I 

maistbba'en&ush 
mawiosa-french 
«wwimsw»-etausH 



nova scotia 

ontarhkksush 

ontawo-french 



qoesec-fbehch 
saskatchewan-ehsush 
saskatchewan- french 



96(0.6) 
95(07) 
95(0.8) 
95(0.9) 
96(05) 
95(0.5) 
96(0.6) 
97(0.5) 
97(0.5) 
94(0.7) 
97(0.3) 
95(12) 
96(0.5) 
97(15) 



MATHS 
MOSTLY 



57(18) 
59(15) 
55(11) 
61 (2.0) 
51 (1.1) 
75(1.0) 
58(1.3) 
45(15) 
59(1.4) 
70(1.2) 
56(1.7) 
44(1.7) 
57(1.4) 
60(4 0) 



souse 

PROBSS 

important 



83(1.0) 
84(1.1) 
81(11) 
88(1.0) 
83(10) 
91(0.6) 
86(10) 
82(13) 
84 (1.0) 
91 (0.8) 
89 (0.8) 
83(1.3) 
87(10) 
86(2.4) 



LSTOTO 

TEACHE R 

EVERYDAY 



62(17) 
37(1.7) 
60(1.5) 
16(1.6) 
63(1.1) 
26(1.1) 
75(15) 
70(17) 
67(1.6) 
22(1.4) 
19(1.4) 
73(1.6) 
55 (2.2) 
14 (2.3) 



DO MATH 
(XEROSES 
EVERY OAT 



i/week 



50(17) 


41 (1.9) 


34(1.6) 


44(1.6) 


49(1.8) 


42(1.6) 


31 (18) 


41 (1.6) 


54(15) 


44(1.3) 


47 (15) 


24(0.9) 


60(14) 


47 (1.6) 


55 (1.6) 


44(1.6) 


55(1.5) 


48(2.0) 


32(1.4) 


33(14) 


40(1.8) 


43(18) 


62(1.6) 


21 (1.9) 


44 (2.0) 


43(16) 


38(35) 


38(3.1) 



TAKE 

TESTS 

1/WEEK 



38(2.7) 
54(1.9) 
37(2.1) 
59(1.7) 
41 (15) 
48(1.1) 
23(1.4) 
32(1.5) 
32(1.6) 
54(1.5) 
49(20) 
99(03) 
20(1.5) 
40(3.3) 



4 HNS/MORE 
MATHKMWK 
EACH MEEK 



15(1.2) 
12(0.8) 
10(08) 
17(15) 
10(0.9) 
17(0.9) 
19(11) 
14 (0.9) 
16(1.3) 
14(15) 
14 (0.8) 
15(1.1) 
11 (10) 
16 (2.6) 



Canadian Popalattans 
ALBERTA 

BRITISH COLUMBIA 

MAM1T0BA-EN8U8H 

MANTTDBA*FREHCH 

HEWIR0IBWTCI-EM0U8H 

MEWBHIWWICK-FREHCH 

KEWFOOHOLAND 

HOVA SCOTIA 

0HTARJOEH8U8H 

O NTARIO -FRENCH 

QUEBEC-EN8U8H 

QUEBEC-FRENCH 

SASKATCHEMAN-EHSUSH 

SASKATCHEWAH-fBEHCH 



WORK WITH 
MATH TOOLS 
1/WEEK 

13(1.0) 
11(11) 
13(1.1) 
10(1.1) 
19 (0.9) 
12(0.6) 
25(15) 
18(11) 
16(15) 
16(15) 
20(1.5) 
10(1.0) 
15(1.2) 
13(21) 



HAVE A EVER USE 
CALCULATOR CALCULATOR 



92(12) 
92(0.8) 
84(1.3) 
88(15) 
89(0.9) 
87 (0.7) 
93(06) 
BS(IO) 
91 (0.8) 
90(09) 
92(0.9) 
92(1.3) 
86(1.2) 
83(2.1) 



85(1.8) 
83(1.8) 
53(24) 
55(1.5) 
87 (0.8) 
72(08) 
89(15) 
60(2.1) 
74 (25) 
75(1.8) 
73(2.4) 
76(2.0) 
67(55) 
73(2.6) 



EVER USE 
COMPUTER 



52(18) 
51 (1.9) 
42(1.7) 
35 (2.0) 
29(12) 
11 (0.7) 
35(19) 
41 (23) 
53(1.9) 
46(1.7) 
16(13) 
43(1.9) 
49(17) 
40 (3.0) 



LAB8UAGE 
HOME/SCH 

91(1.0) 
89(11) 
90(1.0) 
17(10) 
95(0.5) 
90(0.7) 
98(0.3) 
98(0.4) 
87(16) 
55(2.1) 
92(0.9) 
76(2.1) 
95(0.6) 
12(19) 



4/MORE 
BROTHERS 
OR SISTERS 

10(0.9) 

9(0.9) 
11(10) 

9(1.1) 
10(08) 

7 (06) 
12(0.8) 
10(0.9) 

9(08) 

6(0.7) 

5(0.6) 
10(15) 
10(0.7) 

9(1.9) 



LESS 25 
BOOKS 
IN HOME 

10(10) 
10(1.0) 
12(11) 
14(13) 
13(0.7) 
31 (11) 
17(1.1) 
12(14) 
11(0.9) 
26(12) 
19(16) 
10(15) 
13(11) 
14 (23) 



PARENTS 
WANT DO 
WELL 

97 (0.5) 
95 (0.6) 
95(0.6) 
89(1.4) 
95(05} 
96(0.4) 
97(0.4) 
97(04) 
97(r.5) 
9* t 0 6) 
95(0.6) 
97(0.5) 
95 (05) 
89(2.1) 



SOMEONE SOMEONE 

TALKS HELPS 
ABOUT MATH WITH MATH 

Canadian Pnoalattaas 

ALBERTA 63(12) 74(1.1) 

BRITISH COLUMBIA 61(1.4) 70(14) 

ttANflOBA^KSUSH 54(1 3) 85(1.1) 

MANITOBA-FRENCH 56(24) 60(2.0) 

MEW BRUNSWfCK-EHBUSH 57(1 3) 66(1.1) 

KEWBRONSWTCK-FflENCH 67(1.3) 65(1 1) 

NEWFOUNDLAND 67(1 4) 73(1 1) 

HOVA SCOTIA 63(1.1) 69(1.9) 

ONTARIO-ENSLJSH 63(1 5) 72(14) 

ONTARIO-FRENCH 68(1 4) 67(1.7) 

QUEBEC-ENSLSH 67(1 3) 63(1 5) 

QUEBEC-FRENCH 69(1.3) 62(15 

SASKATCHEWAN4N6USH 58(16) 72(1.4) 

SASKATCHEWAN-FRENCH 55(31) 66(32) 



READ 
FOR FUN 
EVERY OAT 



40(1.4) 
40(1.5) 
35(1.3) 
42(18) 
37(1.4) 
31 (11) 
37(1.3) 
35(1.9) 
40(14) 
35(1.4) 
33(1.2) 
37(13) 
40(1.4) 
45(3.1) 



2HRS/MORE 

AUHMWK 

EVERYDAY 



20(13) 
25(15) 
18(1.4) 
19(13) 
16 (0.9) 
17(11) 
26(1.5) 
23(1.2) 
28 (16) 
23(1.3) 
29(19) 
33(19) 
13(0.9) 
15(21) 



5HRS/MORE POSITIVE 
TELEVStOR MATH 
EVERYDAY ATTITUDES 



12(1.0) 
13(10) 
18(15) 
15(1-3) 
19(11) 
16(1.0) 
23(10) 
21 (15) 
16(15) 
17(1.1) 
11(10) 
14 (0.9) 
13(0.9) 
9(18) 



91 (09) 
89 (0.9) 
88(0.8) 
90(1.1) 
88(0.8) 

93 (0.6) 

94 (0.6) 
93(0.7) 
94 (0.7) 
96(0.5) 
95(0.7) 
92(0.8) 
91 (08) 
93(17) 



Mathematics: Age 9, Percent ot Students Reporting 




Canadian Popatetionj 

BRITISH COLUMBIA 

Km BRUNSWICK-ENGLISH 

0NTARKKR8USH 

QHTARS-FRENCH 

OUEBEC-ENSLSH 

QUEBEC-FRENCH 



5HRS/MORE 

TELEVB8JN 

EVERYDAY 

21 (15) 
27(1.0) 
27(1.3) 
19(12) 

19d ?) 

12 (u.9) 



READ 
FOR FUN 
EVERYDAY 

50(1.7) 
48(1.1) 
45(13) 
46(1.7) 
48(1.5) 
52(1.3) 



2HRS/MDRE 

AUHMWK 

EVERYDAY 

13(1.0) 
14(0.9) 
13(10) 
11 (0.9) 
20(15) 
13(1.0) 



MATHS 
FOR BOYS 
AND OWLS 

88(0.9) 
87(0.6) 
85(1.0) 
67(1.3) 
87(1.0) 
83(1.0) 



00 MATH 

EXERCISES 

OFTEN 

50 (1.5) 
55(11) 
52(1.4) 
44(1.4) 
61 (15) 
42(1.3) 



WORK WITH 
MATH TOOLS 
OFTEN 

13(1.1) 
15(1.0) 
14(0.9) 
10(1.0) 
12(0.9) 
11 (1.0) 
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Canadian Data 



Mathematics: Age 13. Percent of Schools Reporting 



EMPHASIZE 



Canadian PopoisJiore 
ALBERTA 

BRITISH COLUMBIA 

MAKTOBA-EJiSUSH 

MANITOBA-FRENCH 

NEWBRUNSVflCN-ENBLiSH 

NEW6ftUeSRC*FRENCH 



Ontario-English 

OnHMMH 

QUEBEC-ENGLISH 

o umtrao i BH 

SASKATCHEWAN-ENGLISH 
SASAATCHEWAR-FRENCH 



72(53) 
67(5.7) 
68(4.6) 
84 (CO) 
62(6.6; 
92(3.8) 
55(42) 
64(5.3) 
79(5.0) 
89(28) 
37(5.9) 
54(7.1) 
75(3.4) 
66(0.0) 



EMPHASIS EMPHASIZE 
FRACTIOUS DECWALS 



66(7.1) 
57(6.7) 
58(47) 
73(0.0) 
36(62) 
44(7.1) 
36(62) 
58(6.7) 
47(7.2) 
71(4.8) 
4? ;9.3) 
44(15) 
62(4.9) 
72 (0.")) 



66(5.4) 
61 ( 5.9) 
73 ( 45) 
84(0.0) 
48(5.5) 
44 (60) 
44(4.5) 
64(7.2) 
66(5.8) 
92(2 7) 
43("*) 
41(6.7) 
70(4 3) 
79(0.0) 



EMPHASIZE 
RATIOS 



69(5.6) 
43(65) 
36(6.5) 
56(0.0) 
40(5.6) 
49(7.7) 
32(46) 
58(65) 
42(7.6) 
55(6.4) 
36(6.3) 
61 (76) 
56(4.7) 
79(0.0) 



EMPHASIZ E 
PE8CEWT 



58(5.9) 
45(6.6) 
48(6.2) 
58(0.0) 
48(5.6) 
41 (7.4) 
42(5.4) 
64 (5.2) 
61 (6.1) 
72(5.5) 
39(4.8) 
58(6.6) 
58(4.5) 
79(00) 



EMPHASIZE EMPHASIZE 
MEASUREMENT GEOMETRY 



64 (54) 

44 (5.9) 
47 (4.5) 
67(0.0) 
58(70) 
49(6.6) 
43(5.8) 
60(66) 
53(59) 
72(7.5) 
45(4.3) 

45 (63) 
53(44) 
55 (00) 



34 (4.9) 
38(6.2) 
34 (6.5) 
49(0.0) 
31 (4.6) 
48(79) 
41 (6.1) 
38(7.2) 
40(53) 
70 (4.6) 
44(73) 
53 (7.2) 
31 (4.6) 
38 (00) 



EMPHASIZE 
TABUS 



19(6.1) 
12 (38) 
20(4.5) 
27(0.0) 
9(32) 
3(03) 
11 (3.6) 
24 (5.3) 
18(44) 
38(7.5) 
24(7.0) 
16(4.9) 
14(3.1) 
17(00) 



EMPHASIZE EMPHASIZE EMPHASIZE MATH 

PROBABILITY STATISTICS ALGEBRA MBt/WK 

Ca mBUn Pbp j I MI p m 

ALBERTA 3(2.0) 9(56) 31(5.8) 214(33) 

BRITISH COLOMBIA 2(1.3) 4(1 5) 45(7 8) 199 ( 6.7) 

NAMTOBA-EJt&USN 3(1.5) 5(23) 44(5.6) 216 4 3 

MANTTOSA-FRENCH 9(00) 11(0.0) 64(0.0) 238 00 

IfEWBRONSWICX-ENGUSH 0(00) 6(2.7) 18(4.0) 256 38 

KEWBRORSWia-fRENCN 2(1.6) 3(2.3) 69(6.1) 304 43 

NEWFOUNDLAND 0(0.0) 4(16) 18 51) 318 74 

mm SCOTIA 4(18) 14(5.0) 28(70) 260 ( 53) 

QNTARIO-EN&LRH 3(2.0) 7(2.8) 39(6.6) 211 (28) 

0M1ARRHREMCR 10(35) 20(92) 64(55 217(43 

QUEBEC-EMSUSH 8(21) 10(6.6) 42(4 8) 273( 19 

QUEBEC-FRENCH 14(46) 16(66) 90(38) 270(7.0) 

SASKATCHEWAIKRQLtSH 4(1.7) 5(1.7) 15(31) 221 (46) 

SASKATCHEWAN-FRENCH 14(00) 14(00) 34(0.0) 226(00) 



NUMBER OF TEACH 
COMPUTERS ONLY MATH 



26(1.7) 
37 ( 2.8) 
15(10) 
18(0.0) 
13(0.8) 
8(0.9) 
7(10) 
12 ( 0.9) 
15 ( 2.0) 
14(1.4) 
15(1.6) 
18 ( 1.5) 
14(08) 
10 ( 0.0) 



57 (68) 
58(65) 
39 (60) 
36(00) 
41 (5.6) 
49(80) 
29(54) 
78(4 8) 

7(24) 
10(25) 
64 (39) 
98 (2.4) 
19 (4.4) 

7(0.0) 



ALL HAVE 
P-8ECMATH 



58(63) 
58(7 5) 
46 (4.3) 
51 (0.0) 
32 (5.5) 
58(7.0) 
65(7.1) 
60(6.4) 
31 (66) 
17(4.1) 
57 (6.0) 
58(6.3) 
62(4.9) 
39(00) 



MATH CLASS 
BY ABILITY 



2(1-8) 
26(6.1) 
5 (22) 
0(00) 
3(18) 
19(6.5) 
6(2.8) 
10(3.0) 
6(2 3) 
8(2.6) 
32(71) 
34(64) 
9 (3.2) 
14(00} 



SCHOOL 
DAY/YEAR 

CiMtfimPomitettMS 

ALBERTA 190 (03) 

BRITISH COLUMBIA 190(12) 
MANTTOBA-ENOLISH 192 (0.4) 
MANTFQBA-FRENCH 194(00) 
NEW BRUNSWICK-ENGLISH 185 (1.3) 
NEW BRUNSWICK-FRENCH 188(08) 
NEWFOUNOLANO 187(0.3) 
NOVA SCOTIA 187(0.5) 
0NTAR8HN0USH 187(0.3) 
ONTARMHRENCH 187 (0.5) 

QUEBEC-ENGLISH 181(05) 
QUEBEC-FRENCH 181 (02) 

SASKATCHEWAN-EN6L>?H 194(05) 
SASKATCHEWAN-FRENCH 195(00) 



INSTRUCTION AVERAGE 1/MORE 
MUMMY CLASS SIZE PROBLEMS 



315(2 8) 


23(0.7) 


5(18) 


304(4 1) 


25(15) 


19(68} 


312(1.7) 


21 (07) 


10(3.3) 


313(0.0) 


20(00) 


13(00) 


296(2.3) 


23(0.4) 


11(30) 


303(2.3) 


24 (0.4) 


271*5) 


289(17) 


24(0.9) 


35 (5 5) 


293(1 7) 


24(11) 


18(3.3) 


304(14) 


27 (0.5) 


11(2.8) 


300(2.4) 


22 (0.6) 


20(3 7) 


302(7.2) 


26 (5.0) 


14(7 9) 


303(2 0} 


28(1.0) 


11(3.5) 


297(1.5) 


21 (0.6) 


11(3.2} 


309(00) 


20 (00) 


21 (0.0) 



Mathematics: Age 9. Percent of Schools Reporting 

MATH GROUPS 
STABILITY 

BRITISH COLUMBIA 31(4 6) 

NEW SBUN8W1CK-EH8USH 13(2.9) 

ONTARIO-ENGLISH 51 (5.6) 

ONTARIO-FRENCH 14(33) 

QUEBEC-ENSL&R 13(3 7) 

QUEBEC-FRENCH 1 (1.0) 
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Februarv 11, 1992 



Dear Colleague: 

Enclosed are copies of the results of ETS's International Assessment of 
Educational Progress (IAEP II) comparing Math and Science achievement of 
groups of 9- and 13-year old students from several countries. These findings 
were released on Wednesday, February 5th, 1992, and I wanted you to have them 
available as soon as possible. 

There have been many criticisms of such surveys in the past, and we have 
paid attention to all of them as we completed this project. We have done our 
utmost to meet or exceed the criteria for these kinds of studies set forth by 
the National Academy of Sciences' Board on International Comparative Studies 
in Education. ETS and the participating countries are proud of the quality of 
the findings. 

When all is said and done, there is one primary reason for conducting 
these studies and that is to discover just what IS POSSIBLE for students to 
achieve in these subject areas. This information can be critical for 
countries in the process of setting standards, especially for those concerned 
with "World- Class" standards. 

Highlights are listed on page 12 in each of the reports and the pull-out 
charts between pages 16 and 17 will help place the achievement data within 
multiple contexts. 

A few points seem to present themselves compellingly as one studies the 

data: 

• The real benefit from these kinds of studies is to identify what is 
possible for 9- or 13-year-olds to achieve especially for 
countries setting goals for themselves. 

• There is no single formula for success. Different patterns of 
practice seem to yield success in different countries and cultures. 
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• America's students in the top 10 percent compare favorably with the 
top 10 percent from other countries as measured by the contents of 
these tests. 

t All countries have segments of their student populations (the bottom 
10 percent) that seem to need special help. 

• Elements like homework, TV viewing, length of school year f length of 
school day, do not relate consistently to performance although there 
are convincing patterns that emerge. 

• It, therefore, seems that each culture or society has to ider^ify its 
own formula for success in achieving its own goals. 

I hope this material will be u»«£ul as you consider goals in Hath and 
Science for your own state. If you have questions, I wouM be pleased to 
address them. 

Sincarely youcfl, 

Archie E. Lapoi^te 
Executive Director 

AEL/bmk 

Enclosures: Learn ing Mathematics 
Learning Science 



cc: Gregory Anrig 
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